18.0
LangSmith is a platform for building, evaluating, deploying, monitoring, and improving AI agents.
Free planWebAPILinux
Alternatives to YoloRouter
YoloRouter centralizes calls to multiple AI providers behind compatible APIs, translating OpenAI, Anthropic, and Gemini protocols when clients and providers differ. Ordered candidates, failover, pooled upstream keys, streaming usage tracking, image and video endpoints, tool-output compression, and detailed key controls cover routing, spending, and access. Teams can run its single binary on Linux, macOS, Windows, the web, an API, or a self-hosted setup. The self-hosted plan…
27.9
Manifest is an open-source LLM gateway for routing model requests, recovering from provider problems, and tracking inference spending.
Free planOpen sourceWebAPILinux
37.6
Bifrost is an AI gateway and control plane for routing, governing, and securing traffic involving model calls, MCP tools, and agents.
Free planOpen sourceWebAPILinux
- 4
TrueFoundry AI Gateway
TrueFoundry AI Gateway sits between applications and model providers, giving teams a single API for managing model access, routing, governance,…
Free planWebAPILinuxSelf-hosted7.6From $499 a month - 57.4$5.50 one-time
- 6
LLM Gateway
LLM Gateway gives product and platform teams one OpenAI-compatible API for routing requests across more than 250 models from over 40 providers.
Free planOpen sourceWebAPIExtensionLinux7.4Free plan - 7
Vercel
Vercel is infrastructure for building, deploying, securing, observing, and scaling apps and agents.
Free planWebAPI7.0$20 usage-based - 8
Helicone
Helicone is a platform for routing, debugging, and analyzing AI applications.
Free planWebAPISelf-hosted6.9From $79 a month - 9
Requesty
Requesty is a managed AI gateway for connecting applications to more than 600 models through one OpenAI-compatible API.
Free planWebAPIExtension6.9Free plan - 10
Cloudflare AI Gateway
Free planWebAPI6.8Free plan - 11
TensorZero
TensorZero is an open-source stack for building and operating applications that use large language models.
Free planWebAPILinuxSelf-hosted6.7Free plan - 12
UniterRouter
UniterRouter is a unified AI gateway available through an API and web interface.
Free planWebAPI6.7From $500 a year - 13
ZenMux
ZenMux provides one API and API key for accessing AI models from OpenAI, Anthropic, Google, DeepSeek, and other providers.
Free planWebAPI6.7From $20 a month - 14
WSO2 AI Gateway
WebAPILinuxmacOS6.6From $119 a month - 15
Envoy AI Gateway
Envoy AI Gateway, now named Agent Router, is an open-source control plane for managing AI and agent traffic using Envoy.
Free planAPILinuxmacOSSelf-hosted6.5Free plan - 16
Routerly
Routerly is a self-hosted gateway that routes application requests to AI providers, tracks usage costs, and enforces budgets.
Free planWebAPILinuxmacOS6.5Free plan - 17
OpenRouter
OpenRouter provides access to hundreds of AI models through a single API endpoint.
Free planWebAPI6.4Free plan - 18
SGLang
SGLang is a free, open-source inference framework for serving language, vision-language, and diffusion models.
Free planAPILinuxmacOSSelf-hosted6.4Free plan - 19
Inference Gateway
Inference Gateway is a free, open-source cloud-native proxy that presents hosted and local language-model providers through one OpenAI-compatible API.
WebAPILinuxmacOS6.2 - 20
LiteLLM
Free planWebAPISelf-hosted6.2Free plan - 21
Orq.ai
Orq.ai is an AI gateway and platform for routing, governing, and observing requests to models and tools.
Free planWebAPISelf-hosted6.2Free plan - 22
Tyk AI Studio Proxy
Tyk AI Studio Proxy is an open-source control plane for managing organizational AI traffic, including LLMs, agents, MCP tool chains, and RAG workloads.
Free planWebAPISelf-hosted6.2Free plan - 23
Polyrouter
Polyrouter is a free, open-source LLM gateway that provides one endpoint for multiple model providers.
Free planWebAPISelf-hosted6.1Free plan - 24
Ramp Router
Ramp Router provides one API endpoint for sending requests to AI models from OpenAI, Anthropic, other providers, and selected open-source sources.
Free planWebAPI6.1Free plan - 25
Martian Gateway
WebAPI6.0 - 26
OpenZiti LLM Gateway
OpenZiti LLM Gateway is a free, Apache 2.0 open-source API proxy for routing requests to OpenAI, Anthropic, and other OpenAI-compatible backends.
APILinuxmacOSSelf-hosted6.0 - 27
Cortecs
WebAPI5.9€5 usage-based - 28
Apache APISIX
Apache APISIX is an open-source gateway for routing, securing, and managing traffic to APIs, microservices, and LLM workloads.
APILinuxSelf-hosted5.8 - 29
vLLM Semantic Router
APILinuxmacOSSelf-hosted5.8 - 30
Prisma AIRS AI Gateway
Prisma AIRS AI Gateway centralizes control, security, and visibility for requests that applications and teams send to large language models.
WebAPISelf-hosted5.5