My website’s Edge Requests has suddenly gone through the roof in the last 6 days, with no visible change in traffic.
I have implemented:
ISR (Incremental Static Regeneration)And nothing has worked. As a free tier user, I got an email saying that my project will be paused if Edge Requests exceed 1 million.
What could possibly be causing this sudden surge? And how do I fix it?
The requests are all coming from gptbot, which is the official ChatGPT crawler. It is unfortunately pretty heavy in its crawling and we're looking at solutions to prevent this from taking down Hobby projects
If you block gptbot from your Firewall tab this will go away, however you also won't show up in ChatGPT searches, so you'll have to make a judgement call appropriate to your project
if you go to Observability -> Edge Requests -> Bot name you can see the identifier
Thank you! Blocking GPTBot via the firewall stopped the problem. I cannot thank you enough.