18.7
Manifest is an open-source LLM gateway for routing model requests, recovering from provider problems, and tracking inference spending.
Free planOpen sourceWebAPILinux
Alternatives to OpenRouter
28.6
LangSmith is a platform for building, evaluating, deploying, monitoring, and improving AI agents.
Free planWebAPILinux
38.3
Bifrost is an AI gateway and control plane for routing, governing, and securing traffic involving model calls, MCP tools, and agents.
Free planOpen sourceWebAPILinux
- 4
LLM Gateway
LLM Gateway gives product and platform teams one OpenAI-compatible API for routing requests across more than 250 models from over 40 providers.
Free planOpen sourceWebAPIExtensionLinux8.2Free plan - 58.1$5.50 one-time
- 6
TrueFoundry AI Gateway
TrueFoundry AI Gateway sits between applications and model providers, giving teams a single API for managing model access, routing, governance,…
Free planWebAPILinuxSelf-hosted8.0From $499 a month - 7
YoloRouter
YoloRouter is an OpenAI-compatible gateway that routes AI model requests across multiple providers.
Free planOpen sourceWebAPILinuxmacOS7.8Free plan - 8
Kong Gateway
Kong Gateway is an open-source API gateway designed for microservices and distributed architectures in hybrid and multi-cloud environments.
Free planWebAPILinuxSelf-hosted7.5Free plan - 9
Helicone
Helicone is a platform for routing, debugging, and analyzing AI applications.
Free planWebAPISelf-hosted7.5From $79 a month - 10
TensorZero
TensorZero is an open-source stack for building and operating applications that use large language models.
Free planWebAPILinuxSelf-hosted7.4Free plan - 11
Requesty
Requesty is a managed AI gateway for connecting applications to more than 600 models through one OpenAI-compatible API.
Free planWebAPIExtension7.4Free plan - 12
Vercel
Vercel is infrastructure for building, deploying, securing, observing, and scaling apps and agents.
Free planWebAPI7.3$20 usage-based - 13
Envoy AI Gateway
Envoy AI Gateway, now named Agent Router, is an open-source control plane for managing AI and agent traffic using Envoy.
Free planAPILinuxmacOSSelf-hosted7.2Free plan - 14
UniterRouter
UniterRouter is a unified AI gateway available through an API and web interface.
Free planWebAPI7.1From $500 a year - 15
Routerly
Routerly is a self-hosted gateway that routes application requests to AI providers, tracks usage costs, and enforces budgets.
Free planWebAPILinuxmacOS7.0Free plan - 16
ZenMux
ZenMux provides one API and API key for accessing AI models from OpenAI, Anthropic, Google, DeepSeek, and other providers.
Free planWebAPI7.0From $20 a month - 17
LiteLLM
Free planWebAPISelf-hosted6.8Free plan - 18
SGLang
SGLang is a free, open-source inference framework for serving language, vision-language, and diffusion models.
Free planAPILinuxmacOSSelf-hosted6.8Free plan - 19
Cloudflare AI Gateway
Free planWebAPI6.8Free plan - 20
Orq.ai
Orq.ai is an AI gateway and platform for routing, governing, and observing requests to models and tools.
Free planWebAPISelf-hosted6.7Free plan - 21
WSO2 AI Gateway
WebAPILinuxmacOS6.7From $119 a month - 22
Polyrouter
Polyrouter is a free, open-source LLM gateway that provides one endpoint for multiple model providers.
Free planWebAPISelf-hosted6.6Free plan - 23
Tyk AI Studio Proxy
Tyk AI Studio Proxy is an open-source control plane for managing organizational AI traffic, including LLMs, agents, MCP tool chains, and RAG workloads.
Free planWebAPISelf-hosted6.6Free plan - 24
Ramp Router
Ramp Router provides one API endpoint for sending requests to AI models from OpenAI, Anthropic, other providers, and selected open-source sources.
Free planWebAPI6.4Free plan - 25
Inference Gateway
Inference Gateway is a free, open-source cloud-native proxy that presents hosted and local language-model providers through one OpenAI-compatible API.
WebAPILinuxmacOS6.4 - 26
Martian Gateway
WebAPI6.2 - 27
OpenZiti LLM Gateway
OpenZiti LLM Gateway is a free, Apache 2.0 open-source API proxy for routing requests to OpenAI, Anthropic, and other OpenAI-compatible backends.
APILinuxmacOSSelf-hosted6.2 - 28
Apache APISIX
Apache APISIX is an open-source gateway for routing, securing, and managing traffic to APIs, microservices, and LLM workloads.
APILinuxSelf-hosted6.0 - 29
Cortecs
WebAPI6.0€5 usage-based - 30
vLLM Semantic Router
APILinuxmacOSSelf-hosted5.9