LLM Gateway
LLM Gateway gives product and platform teams one OpenAI-compatible API for routing requests across more than 250 models from over 40 providers.
What LLM Gateway is
LLM Gateway gives product and platform teams one OpenAI-compatible API for routing requests across more than 250 models from over 40 providers. If a provider errors, times out, or rate-limits a request, the gateway can retry up to twice with another provider for the same model. Its dashboard tracks request, token, spend, latency, error, and cache metrics, with breakdowns by model and provider. Teams can use their own provider API keys without a platform fee and pay providers directly. The open-source core is licensed under AGPLv3 and can be self-hosted for free; enterprise features require a license. Published integration guides cover tools including Claude Code, Cursor, Codex CLI, Cline, n8n, and VS Code. The Free plan costs nothing forever, has a 5% fee on credit usage, and includes 200+ models across 40+ providers, activity logs, and export. It allows 20 requests per minute on free models; paid models are not rate limited. Enterprise adds custom routing, SSO, centrally configured guardrails, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support; pricing is custom.
Good
- Routes requests across 250+ models and 40+ providers.
- Retries eligible requests up to twice.
- Tracks spend, latency, errors, and cache metrics.
- Core is open source and self-hostable.
- Bring-your-own-key usage has no platform fee.
Watch out
- Free plan charges a 5% fee on credit usage.
- Free models are limited to 20 requests per minute.
- Enterprise pricing is custom and unlisted.
Who it suits
LLM Gateway suits product and platform teams routing application requests to multiple model providers. Organizations deploying LLM infrastructure across teams may consider its enterprise identity, guardrail, and support options.
Verdict
LLM Gateway centralizes provider routing and usage analytics, with a free plan and self-hostable open-source core. Teams should note the Free plan's credit fee and request limit, while enterprise pricing requires an inquiry.
Plans and prices
From LLM Gateway's own pricing page, checked 15 Oct 2026.
| Plan | Price | What it gives you |
|---|---|---|
| Free | Free | 200+ models · 40+ providers · free models rate-limited to 20 requests/minute · metadata-only logs · Discord support · forever |
| Enterprise | Priced on request | 30-day trial · all models · custom routing · full payload retention for 30 days · SSO/SAML/OIDC with SCIM · audit logs · guardrails · contractual SLA · 24/7 support · custom |
The facts
Each one read from LLM Gateway's own pages, with the date it was checked.
What it does
- Analytics
- The dashboard tracks request, token, spend, latency, error, and cache metrics, with breakdowns by model and provider.checked 7 Oct 2026
- API surface
- Documented endpoints include chat completions, responses, Anthropic messages, embeddings, images, speech, transcription, moderation, search, video and realtime operations.checked 15 Oct 2026
- Automatic routing
- The gateway selects providers using availability, latency, throughput, price and cache-related signals, with configurable routing behavior.checked 15 Oct 2026
- BYOK
- Customers may store their own provider keys and use routing and analytics without a platform fee.checked 15 Oct 2026
- Caching
- Projects can enable response caching to reduce repeated-request latency and token expense.checked 15 Oct 2026
- Credit pricing
- Pay-as-you-go credits use provider list token rates plus a flat 5% fee when credits are purchased; international cards add 1.5%.checked 15 Oct 2026
- Data retention
- Pricing lists metadata retention as free and full payload retention at $0.01 per 1 million tokens; the Free plan includes activity logs and export.checked 7 Oct 2026
- Documentation depth
- The documentation includes feature guides, dashboard knowledge-base articles, integration material, self-hosting sections, developer tools and an API reference.checked 15 Oct 2026
- Enterprise identity
- Enterprise SSO supports SAML 2.0 and OIDC with SCIM provisioning and group-based role mapping.checked 7 Oct 2026
- Enterprise limits
- Enterprise plans include unlimited seats and unlimited data retention, according to the enterprise page.checked 7 Oct 2026
- Enterprise pricing
- Enterprise pricing is contact-based and offers volume discounts, custom limits and contractual service levels.checked 15 Oct 2026
- Failover
- When a provider errors, times out or rate-limits, the gateway can retry on another provider for the same model, up to two times.checked 15 Oct 2026
- Guardrails
- Enterprise guardrails can detect prompt injection, jailbreak attempts, personally identifying information, payment-card data and secrets, with block, redact or warn actions.checked 15 Oct 2026
- Identity controls
- Enterprise supports SAML 2.0 or OIDC single sign-on, SCIM provisioning and organization/project roles.checked 15 Oct 2026
- Independent assessment: API caveat
- GatewayScore reports that latency-based routing applies only to streaming requests and that non-auto tool choices may be downgraded when no mapping supports them.checked 15 Oct 2026
- Independent assessment: compliance gap
- GatewayScore says SOC 2 is published but found no unconditional zero-retention guarantee or HIPAA business-associate agreement.checked 15 Oct 2026
- Independent assessment: deployment documentation
- GatewayScore found hosted and self-host deployment documented, while VPC, on-premises and air-gapped deployment were not documented on the reviewed pages.checked 15 Oct 2026
- Independent assessment: pricing
- Vantaige characterizes the gateway as freemium, with free BYOK and self-hosting and a 5% managed-credit fee.checked 15 Oct 2026
- Independent praise: unified access
- The same Reddit announcement highlights one API, provider fallback and usage/cost tracking as the core benefit for application developers.checked 15 Oct 2026
- Independent product description
- A Reddit post by a project builder describes hosted pay-as-you-go access, provider-key mode and AGPLv3 self-hosting, with separate commercial licensing for enterprise code.checked 15 Oct 2026
- Independent technical footprint
- Gridinsoft detected React, Next.js, Sonner notifications, Google Cloud hosting and a linked GitHub profile for the site.checked 15 Oct 2026
- Independent trust check
- Gridinsoft gave llmgateway.io a 76/100 automated trust score, reporting no major malware or phishing detections and a domain registration date of May 20, 2025.checked 15 Oct 2026
- Integrations
- Published integration guides cover Claude Code, Cursor, Cline, n8n, VS Code, Codex CLI, OpenCode, Continue, Kilo Code, Kimi Code and other coding tools.checked 15 Oct 2026
The company
- Company size
- LinkedIn classifies llm-gateway as a self-employed information-services organization with 2–10 employees.checked 15 Oct 2026
Alternatives to LLM Gateway
- 1
Manifest
Free planOpen sourceWebAPILinuxSelf-hosted8.7From $19 a month - 2
LangSmith
Free planWebAPILinuxmacOS8.6$39 usage-based - 3
Bifrost
Free planOpen sourceWebAPILinuxmacOS8.3Free plan - 4
Eden AI
WebAPI8.1$5.50 one-time - 5
TrueFoundry AI Gateway
Free planWebAPILinuxSelf-hosted8.0From $499 a month - 6
YoloRouter
Free planOpen sourceWebAPILinuxmacOS7.8Free plan