LLM Gateway
8.2#4 in llm gatewaysFree planFree planWebAPIExtensionLinux
Visit| Fact | LLM Gateway | Polyrouter |
|---|---|---|
| Integrations | Published integration guides cover Claude Code, Cursor, Cline, n8n, VS Code, Codex CLI, OpenCode, Continue, Kilo Code, Kimi Code and other coding tools. | Provider options include API keys, OAuth subscriptions, compatible custom endpoints, and self-hosted local models including Ollama, LM Studio, and llama.cpp. |
| Product | LLM Gateway provides one OpenAI-compatible API to route requests across 250+ models from 40+ providers. | Polyrouter is an open-source LLM gateway that puts one endpoint in front of multiple model providers. |
| Routing | The gateway can retry up to twice with another provider for the same model when a provider errors, times out, or rate-limits a request. | It supports explicit model selection, header rules, routing tiers, and optional automatic routing layers. |
| Security | The company states that it is SOC 2 Type II audited and GDPR-aligned, and describes TLS in transit and AES-256 encryption at rest. | Provider and notification credentials are encrypted at rest, and user-supplied URLs are checked against private and metadata address ranges. |
| Support | The Free plan lists Discord Community support, while Enterprise includes 24/7 priority support through a dedicated Slack or Discord channel. | The maker directs bug reports, feature requests, and questions to GitHub. |
LLM Gateway suits product and platform teams routing application requests to multiple model providers. Organizations deploying LLM infrastructure across teams may consider its enterprise identity, guardrail, and support options.
Polyrouter may suit developers and teams who want one endpoint to route requests across model providers, set budgets, and configure fallbacks. It is self-hosted software requiring Docker with Compose v2, PostgreSQL 16, and Redis.