Community Session: AI Gateway

Events
,
1

Join us for a Vercel Community Live Session with our product team, where we’ll dive into the AI Gateway - a proxy service from Vercel that routes model requests to various AI providers.

Speakers

Harpreet Arora
Harpreet Arora240×240 105 KB
Walter Korman
Walter Korman240×240 90.9 KB
Harpreet Arora Walter Korman
Product Manager Software Engineer
LinkedIn LinkedIn

Moderators

Pauline P. Narvas
Pauline P. Narvas400×400 92.4 KB
Jacob Paris
Jacob Paris240×240 77.6 KB
Pauline Narvas (@pawlean) Jacob Paris (@jacobparis)
Community Community
Twitter/X | LinkedIn | Bluesky Twitter/X | LinkedIn | Bluesky
2
Originally sent in Community Session: AI Gateway
system

@pawlean moved a message to the Vercel channel.

pawlean

Can't wait for this session! :smiley:

gabby-2486

Super pumped for this one!

plus 2
burnedchris

this is going to be cool!

100 2
gabby-2486

Tuning in from the United States (Ohio) and I’m hoping to learn how to use AI Gateway to reduce spend for product use cases where there are multiple functionalities that can use different models

pawlean

Hi and welcome, Gabby! <3

jacobparis

My fave part of gateway is never needing to API key hunting from a bunch of other services

100 1
gabby-2486

Oh yes! On rate limits - is there a way to set parameters for when you want to switch models before it hits rate limits. Also, is there a way to trigger querying your own database versus using an external model in predefined circumstances? For example, if you built a question/answer chatbot for your website - can you have the Vercel AI Gateway query your own question and answer database instead of a language model if it’s a common question you’ve already documented?

red_question_mark 1
pawlean

TIL :exploding_head:

Demo gods lol

If you have any questions, drop them here!

This is so cool

burnedchris

What is your fav model that is the right balance between cost to performance?

How do we keep up with the capabilities of AI, AI SDK as its always changing and evolving

pawlean

Great questions!

Will ask next :eyes:

Any more questions, folks?

Drop your feedback and thoughts in Feedback :D

amyegan

Great session @harpreet-3932 and @shaper!

100 1
pawlean

Thanks folks! See you all soon :D