LLM Gateway
8.2#4 in llm gatewaysFree planFree planWebAPIExtensionLinux
Visit
| Fact | LLM Gateway | TensorZero |
|---|---|---|
| Integrations | Published integration guides cover Claude Code, Cursor, Cline, n8n, VS Code, Codex CLI, OpenCode, Continue, Kilo Code, Kimi Code and other coding tools. | Documented providers include Anthropic, AWS Bedrock, Azure, Google, OpenAI, OpenRouter, Together AI, vLLM, and OpenAI-compatible endpoints. |
| Observability | Dashboards expose requests, tokens, latency, errors, cache status and spending broken down by model, provider, project and API key. | TensorZero can store inference and feedback data for observability, optimization, evaluations, and experimentation in Postgres or ClickHouse. |
| Product | LLM Gateway provides one OpenAI-compatible API to route requests across 250+ models from 40+ providers. | TensorZero is described in its documentation as an open-source stack combining an LLM gateway, observability, optimization, evaluation, and experimentation. |
| Security | The company states that it is SOC 2 Type II audited and GDPR-aligned, and describes TLS in transit and AES-256 encryption at rest. | TensorZero's privacy policy says it uses physical, technical, organizational, and administrative security measures to protect personal data. |
| Support | The Free plan lists Discord Community support, while Enterprise includes 24/7 priority support through a dedicated Slack or Discord channel. | The documentation directs users to Slack or Discord for questions and offers a team Slack or Teams channel by email. |
LLM Gateway suits product and platform teams routing application requests to multiple model providers. Organizations deploying LLM infrastructure across teams may consider its enterprise identity, guardrail, and support options.
TensorZero suits teams that want a self-hosted gateway and data tools for LLM applications, with routing, evaluation, and experimentation. It is a poor fit for teams that require an actively maintained project.