Hello,
I'm seeing an issue with the SSE (Server-Sent Events) stream. Here's what's happening:
The stream starts normally and processes messages After about 1 minute, it ends abruptly
The last log message shows:
"usage": {
"prompt_tokens": 2352,
"completion_tokens": 4000,
"total_tokens": 6352
}
We're using Server-Sent Events (SSE) for streaming The stream ends without any error message We're not getting any proper notification about why the stream ended
Is this a timeout or token limit issue?