Parse custom response message and use it instead

AI SDK
, ,
1

We get the method to prepare the send message schema / format for the request message using prepareSendMessage() function in useChat(), but I was wondering if there was a similar way for the response messages as well. Currently the backend system doesn’t support text streaming and gives the response in one-go. Would be super helpful if anyone has done it.

I am currently using AI SDK in frontend and for backend using Ollama with FastAPI. Wanted to checkout on text stream protocol but seems like the example has been deprecated as of AI SDK v6.

Request format:

{
  query: "" (string)
  url: "" (string)
}

Response format:

{
  response: "" (string)
  references: \[""\] (string\[\])
}
4

You could use the the onFinish callback in useChat() or implement a custom message transformation.

1 Like
5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.