Hi Vercel team,
I'm hoping someone can take a look at billing case CSE_01JOyvs3CumNyEOC, which has been open since November 3 without a reply.
What happened: between about October 11 and 26, Google's GoogleOther crawler looped through an unbounded set of URLs on my portfolio. That was my bug, and it's fixed. Observability attributes 71.3M requests in that period to googleother, tagged as a verified Google crawler.
The part I'd like checked: the Web Analytics docs say traffic from automated processes isn't counted, based on the User-Agent header (https://vercel.com/docs/analytics#bots). GoogleOther's mobile User-Agent ends in (compatible; GoogleOther). Even so, Web Analytics recorded 28.8M page views from 599 "visitors", all Android / Chrome Mobile / United States, and billed 27.6M events ($828.21). That's most of a cycle on a site that normally has fewer than 100 visitors a month.
Where it stands:
- The self-serve refund form approved the crawler items on the first invoice ($162.89). Thank you for that.
- On the main invoice (54DF8B09-0004), the same items come to $995.23. The form declined that as above its limit, and the support assistant said it needs manual review on the case.
- On my side: robots.txt disallows the URLs, the links are nofollow, middleware is scoped to one route, analytics
beforeSenddrops the section, there's a Firewall rule for GoogleOther, and a $50 spend limit with Pause.
Two questions:
- Does the Web Analytics bot filter recognise GoogleOther? If not, is that a known gap?
- Could someone on billing pick up the case?
Thanks, Daniel