Hi there, For a few months now, I was using the Vercel AI Gateway to generate JSON objects with a zod schema. I am currently using AI SDK@5.0.27 with the gpt-oss-20, gpt-oss-120, and haiku-4.5 models. Current Behavior [Bildschirmfoto 2026-03-03 um 08.07.36] Latency: Response times usually were …

Hi @madebyfabian , welcome to the Vercel Community! I’m sorry that you’re facing degraded performance. Could you confirm when you first noticed it? Also, could you share a minimal code that you’re able to recreate the JSON failure or 45-60s response times for? I will try to use the same code to rec…

Thanks! It seems that it first appeared yesterday, March 2nd, 17:00 UTC. Before that, everything was working. [Bildschirmfoto 2026-03-03 um 11.54.31] I tried to create a minimal reproduction. Original prompt is longer and the input is just demo. The task is to translate and keep the JSON structu…

Hey, I can see it. It was mistakingly flagged by our AI moderation. I’ll take a look at it now.

I just upgraded to v6 and used the generateText with the new syntax like this: ▶ Code Still the same issue. I tried to only use groq with the providerOptions, same issue still. I tried to change model to e.g. gpt-5-nano, the response then took almost 2 minutes but it responded successful. Update: …

Hi @madebyfabian , thanks for sharing the code snippets. Could you also share the system prompt used in the above example? Also, which region are you using this code in? For example, I’m sitting in the Netherlands right now.

Sure, I updated the Code example. I am in Nuremberg, Germany right now. So should be FRA. I think changing everything to the gpt-oss-120b solves it for now. I could guarantee I checked it a few hours ago and it didn’t work with 120b either. So maybe the 20b will also be fixed in a few hours?

Hi @madebyfabian , thanks for confirming the model behavior. I’m also testing some of the models you mentioned and for me: "sortedBySpeed": [ { "model": "openai/gpt-oss-20b", "timeMs": 8553, "success": true }, { "model": "google/gemini-2.5-flash-lite", "ti…

Hi there! What was the response from the team regarding the latency spikes? Since we talked, I fully moved to gpt-oss-120b, and now everything mostly works fine. But sometimes (1-3x a day), I get extremely high latency (60-400+ seconds) and failing AI requests. So similar to the original issue, ju…

Hi @madebyfabian , it appeared to be a transitory issue back then but since you’re facing it again even with this model. I’ll ask the team again what could be wrong here.

Vercel AI Gateway latency and provider routing issues with generateObject

AI SDK

madebyfabian (Fabian) March 3, 2026, 11:10am 8

Hi there, thanks! Seems like my initial answer was hidden, can you see it?

Topic		Replies	Views
🚀 V0 BUG ：AI Gateway Performance Issue v0 ai-sdk , ai-gateway	3	95	January 23, 2026
AI Gateway Bug:Selected 4.1 Opus but Routes to 3 Opus (verified)hobby Help	9	213	August 25, 2025
AI Gateway when using your own API keys Help ai	2	243	November 16, 2025
LiteLLM Gateway is now available on Vercel Announcements changelog	0	63	March 11, 2026
Image generation in the AI Gateway v0 feature-request	4	110	December 1, 2025

Vercel AI Gateway latency and provider routing issues with generateObject

Related topics