Unexpected spike in Vercel Edge Requests without traffic increase

Problem

My website’s Edge Requests has suddenly gone through the roof in the last 6 days, with no visible change in traffic.

What I’ve Tried

I have implemented:

  • Caching
  • Bot blocking
  • ISR (Incremental Static Regeneration)

And nothing has worked. As a free tier user, I got an email saying that my project will be paused if Edge Requests exceed 1 million.

Questions

What could possibly be causing this sudden surge? And how do I fix it?

The requests are all coming from gptbot, which is the official ChatGPT crawler. It is unfortunately pretty heavy in its crawling and we’re looking at solutions to prevent this from taking down Hobby projects

If you block gptbot from your Firewall tab this will go away, however you also won’t show up in ChatGPT searches, so you’ll have to make a judgement call appropriate to your project

if you go to Observability → Edge Requests → Bot name you can see the identifier

1 Like

Thank you! Blocking GPTBot via the firewall stopped the problem. I cannot thank you enough.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.