Implementing LanguageModelV1 Interface needed?

it-lean-fsch · February 21, 2025, 9:45am

Hello people. I need a push in the right direction because I think I am doing something wrong here, or misunderstanding it.

Currently I am using the AI Chatbot template. It gives great functionality and I wish to use it. However I am stuck with implementing my own Model.

Actual Question:
I need to add a new custom model which I have somewhere in a remote URL. This model just streams back text. Do I need to implement a customProvider for this as described here:

Or am I missing something completely? I am specifically talking about the backend code see below.
I did a shitty frontend where as POC where the stream back works but I cant get it to integrate with the provided structure of the vercel ai sdk.

Any tips or pushes in the correct direction would be greatly appreciated

github.com/vercel/ai-chatbot

lib/ai/models.ts

main

import { openai } from '@ai-sdk/openai';
import { fireworks } from '@ai-sdk/fireworks';
import {
  customProvider,
  extractReasoningMiddleware,
  wrapLanguageModel,
} from 'ai';

export const DEFAULT_CHAT_MODEL: string = 'chat-model-small';

export const myProvider = customProvider({
  languageModels: {
    'chat-model-small': openai('gpt-4o-mini'),
    'chat-model-large': openai('gpt-4o'),
    'chat-model-reasoning': wrapLanguageModel({
      model: fireworks('accounts/fireworks/models/deepseek-r1'),
      middleware: extractReasoningMiddleware({ tagName: 'think' }),
    }),
    'title-model': openai('gpt-4-turbo'),
    'artifact-model': openai('gpt-4o-mini'),

This file has been truncated. show original

pawlean · February 28, 2025, 1:54pm

Hi, David! Welcome to the Vercel Community

I admittedly haven’t played around with the AI SDK as much to add many comments. However, I did ask v0 for some pointers → Vercel AI Custom Model Integration – v0 by Vercel

Let me know if that helps!

Topic		Replies	Views
Vercel AI SDK Help ai	1	21	March 31, 2025
Vercel AI SDK: How do I make this work with a separate Node JS Backend Help ai-sdk	1	25	February 1, 2025
Need an ai-chatbot npm package Discussions react , ai	5	52	March 25, 2025
I built a Kanban Board with Next.js,Vercel AI and Tolgee Showcase nextjs , ai-sdk	4	81	December 26, 2024
Azure Open AI integration v0 v0 , ai	4	44	March 1, 2025

Implementing LanguageModelV1 Interface needed?

Related topics