Hi Vercel team, could the AI Gateway Batch team confirm whether a supported Batch route can preserve this Responses profile on our existing Gateway account? Our current endpoint is https://ai-gateway.vercel.sh/v1/responses.
{ "model": "openai/gpt-6.1-sol", "background": false, "max_output_tokens": 32000, "parallel_tool_calls": false, "providerOptions": { "gateway": { "only": [ "openai" ] } }, "reasoning": { "effort": "xhigh", "mode": "standard" }, "service_tier": "default", "store": false, "stream": true, "text": { "format": { "type": "json_object" } }, "tool_choice": "none", "tools": [], "truncation": "disabled"}The complete instructions and input must remain unchanged. Only the separate Batch submission may change stream to false; the model ID, OpenAI-only routing and account must stay the same.
Could you clarify:
-
Supported route and request fidelity: Does Gateway support OpenAI Files/Batches or a raw Responses option in SDK Batch? Please provide the API/schema, required versions and any access requirements. Our review of the published Responses serializer and tool preparation found omitted
background:false, droppedtools:[]/tool_choice:"none", and added encrypted-reasoninginclude. Can a supported route avoid those changes? -
Original receipts: Can we retrieve original per-item request/response bodies and raw result records, beyond normalized SDK results? We need correlation with our item IDs and Gateway/provider batch, request and response IDs where available; effective model/provider; terminal status including partial failures; and complete usage, including cache and reasoning tokens. Which fields are guaranteed, and for how long are they retained?
-
Billing and recovery: What authoritative original-account evidence supports independent per-item charge reconciliation, including currency, discounts, cache usage, fees and partial failures? If billing is batch-level, how can each item be reconciled without estimates? What idempotency, retry/fallback and interrupted-submission recovery guarantees prevent duplicate work or charges?
Documentation or sanitized request/result examples would help. If these requirements are unsupported, please identify the gaps.