Envoy AI Gateway
7.2#13 in llm gatewaysFree planFree planAPILinuxmacOSSelf-hosted
Visit| Fact | Envoy AI Gateway | LLM Gateway |
|---|---|---|
| Observability | The CLI supports OpenTelemetry tracing and can record request and response details; the documentation describes configuration to hide input and output content. | Dashboards expose requests, tokens, latency, errors, cache status and spending broken down by model, provider, project and API key. |
| Security | The project describes upstream authentication for securing connections to AI services and says provider credentials can be kept out of application workloads. | The company states that it is SOC 2 Type II audited and GDPR-aligned, and describes TLS in transit and AES-256 encryption at rest. |
| Support | The project directs users to its community Discord and GitHub issues for help. | The Free plan lists Discord Community support, while Enterprise includes 24/7 priority support through a dedicated Slack or Discord channel. |
Agent Router may suit teams that share AI models or tools and want centralized credentials, quotas, usage attribution, or failover. It is also relevant to teams deploying AI traffic management locally or on compatible Kubernetes infrastructure.
LLM Gateway suits product and platform teams routing application requests to multiple model providers. Organizations deploying LLM infrastructure across teams may consider its enterprise identity, guardrail, and support options.