I'm experiencing two related issues with zai/glm-5.1 through AI Gateway:
- Reasoning cannot be disabled. The documented controls (
reasoning: { "effort": "none" },reasoning: { "enabled": false }) are accepted but not honored by 5 of the 6 providers serving this model. Only baseten actually disables thinking.
Context: we're benchmarking GLM-5.1 for a latency-critical voice agent, so ~100–250 hidden reasoning tokens before the first content token (2.5–10s of added TTFT/TTFAT) makes the model unusable.
Issue 1: reasoning disable not forwarded/honored
| provider | reasoning option | total | out_tokens | reasoning_tokens |
|---|---|---|---|---|
| baseten | {"enabled": false} | 449 ms | 1 | 0 |
| baseten | {"effort": "none"} | 423 ms | 1 | 0 |
| togetherai | {"enabled": false} | 3995 ms | 176 | 158 |
| togetherai | {"effort": "none"} | 5711 ms | 102 | 85 |
| fireworks | {"enabled": false} | 4444 ms | 182 | 180 |
| fireworks | {"effort": "none"} | 2841 ms | 189 | 178 |
| deepinfra | {"enabled": false} | 3863 ms | 274 | 265 |
| deepinfra | {"effort": "none"} | 2552 ms | 124 | 108 |
| novita | {"enabled": false} | 6290 ms | 156 | 153 |
| novita | {"effort": "none"} | 9876 ms | 188 | 185 |
| zai | {"enabled": false} | 4951 ms | 159 | 156 |
| zai | {"effort": "none"} | 4731 ms | 164 | 161 |
Notes:
- Per the advanced configuration docs,
effort: "none""disables reasoning". It doesn't for this model on 5/6 providers. {"enabled": false}is worse than a no-op: it hides the reasoning text from the stream but the tokens are still generated and billed (reasoning_chars=0whilereasoning_tokens=150+). That's easy to misread as "thinking disabled" while you still pay the full latency and cost.