Best LLM Gateways in 2026 · page 2
- 26
Inference Gateway
Inference Gateway is a free, open-source cloud-native proxy that presents hosted and local language-model providers through one OpenAI-compatible API.
WebAPILinuxmacOS6.4 - 27
Martian Gateway
WebAPI6.2 - 28
OpenZiti LLM Gateway
OpenZiti LLM Gateway is a free, Apache 2.0 open-source API proxy for routing requests to OpenAI, Anthropic, and other OpenAI-compatible backends.
APILinuxmacOSSelf-hosted6.2 - 29
Apache APISIX
Apache APISIX is an open-source gateway for routing, securing, and managing traffic to APIs, microservices, and LLM workloads.
APILinuxSelf-hosted6.0 - 30
Cortecs
WebAPI6.0€5 usage-based - 31
vLLM Semantic Router
APILinuxmacOSSelf-hosted5.9 - 32
Prisma AIRS AI Gateway
Prisma AIRS AI Gateway centralizes control, security, and visibility for requests that applications and teams send to large language models.
WebAPISelf-hosted5.6 - 33
5.1