From my inspection of the forum I see other people have the same issue, or a slight variation. The symptom i experience are the same as this post: https://community.vercel.com/t/purchased-domain-through-vercel-third-party-registrar/8561/7
The difference is that my card was charged. So I can't just delete the domain and try again.