Hello community!
My name is Phil.
I’m looking for advice on building agentic apps (RAG) using Azure Foundry + TypeScript.
Azure itself provides Foundry Agent Service and its own SDK. From what I see now, I might need their SDK to connect to Foundry’s Project and Model, and maybe set up continuous evaluation for my agent(s).
On the flip side, I don’t want to lose a DX that AI SDK or such frameworks like Next and Mastra would give me.
I’m aware of Azure OpenAI Provider, but it seems like it works with OpenAI-compatible models deployed in Azure OpenAI Service (correct me if I’m wrong). As well as Community azure-ai-provider which I can’t consider as mature and battle-tested.
Unfortunatelly, from what I see you either build everything manually like here and here (note @azure/ai-projects SDK is listed but not used), or you go with vanilla Foundry Agent Service like here.
To sum up:
-
I can’t limit myself to the OpenAI models only, so I assume that I can’t use Azure OpenAI Service → therefore, Azure AI Foundry is my choice.
-
As of today, I need to build a RAG Agentic App with the conversational UI interface → that’s why I was thinking about modern AI SDK-like frameworks since they have good integration with UI frameworks like CopilotKit.
-
On the flip side, I don’t want to lose in observability, reliability, and testing (read: evaluations), which seems like AI Foundry’s strong point.
-
If I create a project inside AI Foundry, wondering if I can connect it with the AI SDK-like frameworks, not losing in benefits described in p.3?
4.1. If no, my option is obvious → Foundry Agent Service and its official SDK
4.2. If yes, what are the examples of connecting AI SDK-like to AI Foundry project? These stackoverflow question, reddit post, and GH thread make me feel this is a risky endeavour.
Thanks in advance!
