LLM Gateway
8.2#4 in llm gatewaysFree planFree planWebAPIExtensionLinux
VisitLLM Gateway vs Routerly
What both publish
| Fact | LLM Gateway | Routerly |
|---|---|---|
| Integrations | Published integration guides cover Claude Code, Cursor, Cline, n8n, VS Code, Codex CLI, OpenCode, Continue, Kilo Code, Kimi Code and other coding tools. | The site names Cursor, Open WebUI, OpenClaw, LangChain, and LlamaIndex as clients or frameworks that can connect to Routerly. |
| Product | LLM Gateway provides one OpenAI-compatible API to route requests across 250+ models from 40+ providers. | Routerly is a self-hosted gateway between applications and AI providers that routes requests, tracks costs, and enforces budgets. |
| Routing | The gateway can retry up to twice with another provider for the same model when a provider errors, times out, or rate-limits a request. | Its routing engine uses up to nine configurable policies, including LLM selection, cost, health, performance, capability, context, budget, rate limits, and fairness. |
| Security | The company states that it is SOC 2 Type II audited and GDPR-aligned, and describes TLS in transit and AES-256 encryption at rest. | The documentation says provider API keys and project tokens are AES-256 encrypted at rest, and user passwords are bcrypt-hashed. |
LLM Gateway plans
- FreeFree
- EnterprisePriced on request
Routerly plans
- Free self-hostedFree
Pick LLM Gateway if…
LLM Gateway suits product and platform teams routing application requests to multiple model providers. Organizations deploying LLM infrastructure across teams may consider its enterprise identity, guardrail, and support options.
Pick Routerly if…
Routerly is aimed at developers and teams, including SaaS groups and local-first projects, that want to manage AI-provider routing and budgets on their own infrastructure. It may suit users who need project-level separation and compatible OpenAI- or Anthropic-format clients.