agentgateway

Visit site Alternatives

Score6.7

Rank#4 of 27

PriceFree

Free planYes

Runs onAPI, Linux, Self-hosted

Summary

Agentgateway is a free, open-source HTTP and gRPC gateway for routing, securing, observing, and governing traffic involving services, LLMs, MCP, and agent-to-agent systems. Its LLM gateway exposes an OpenAI-compatible API for providers such as OpenAI, Anthropic, Bedrock, Gemini, Vertex, and OSS Llama runs. Self-hosted inference routing supports vLLM, TGI, and Triton, with routing decisions based on latency, cost, and model. For MCP, it supports server discovery, scoped tool calls, and audit trails; for A2A, it routes between agent runtimes including LangChain, CrewAI, and ADK. Security controls include JWT and OIDC, API keys, authorization policies, TLS and mTLS with certificate rotation, and rate limiting. MCP and prompt guards can check calls and responses for prompt injection or unsafe payloads. Observability includes OpenTelemetry, Prometheus token-usage histograms, Jaeger traces, and request logs showing latency, token counts, and realized USD cost. The gateway can be deployed as a standalone binary, in Docker, or on Kubernetes. The project is self-hosted; commercial support is listed through a partner.

Who it is for

Agentgateway is aimed at platform engineers, tool-builders, and AI enthusiasts who need self-hosted traffic controls for services, LLMs, or agent systems. It also suits platform teams seeking routing, security, and observability features in one gateway.

What is good

Free and open source.
Supports HTTP and gRPC traffic.
Includes rate limiting and authorization policies.
Offers OpenTelemetry, Prometheus, and Jaeger observability.
Deploys as a binary, Docker container, or Kubernetes workload.

What to know first

Deployment is self-hosted.
Commercial support is listed through a partner.
TLS certificate rotation and gateway operation require deployment management.

Verdict

Agentgateway brings routing, access controls, guardrails, and observability to multiple kinds of AI and service traffic. Teams should account for operating its self-hosted deployment and arrange support if needed.

agentgateway plans and pricing

All plans

agentgateway (open source) Free Open-source gateway; binary, Docker, or Kubernetes deployment agentgateway.dev · 2 Oct 2026

Compared on Kubernetes ingress controllers

Free plan: Yesagentgateway.dev
Ingress API model: bothagentgateway.dev
TLS automation: Yesagentgateway.dev
Canary routing: Yesagentgateway.dev
Rate limiting: Yesagentgateway.dev
Auth policies: Yesagentgateway.dev
Deployment model: self-hostedagentgateway.dev

Facts

Purpose: Agentgateway is an open-source HTTP and gRPC gateway for routing, securing, observing, and governing service, LLM, MCP, and agent-to-agent traffic.agentgateway.dev · 2 Oct 2026
LLM routing: Its LLM gateway provides an OpenAI-compatible API for providers including OpenAI, Anthropic, Bedrock, Gemini, Vertex, and OSS Llama runs.agentgateway.dev · 2 Oct 2026
Inference: Self-hosted inference routing supports vLLM, TGI, and Triton, with latency-aware, cost-aware, and model-aware routing.agentgateway.dev · 2 Oct 2026
MCP and A2A: The gateway supports MCP server discovery, scoped tool calls and audit trails, and A2A routing between LangChain, CrewAI, ADK, and other runtimes.agentgateway.dev · 2 Oct 2026
Security: Listed security features include JWT and OIDC, API keys, authorization policies, TLS and mTLS with certificate rotation, and rate limiting.agentgateway.dev · 2 Oct 2026
Guardrails: MCP guardrails inspect calls and responses for prompt injection and unsafe payloads, while prompt guards support checks and redaction.agentgateway.dev · 2 Oct 2026
Observability: The site describes OpenTelemetry by default, Prometheus token-usage histograms, Jaeger traces, and request logs with latency, token counts, and realized USD cost.agentgateway.dev · 2 Oct 2026
Cost controls: Features include scoped virtual keys, per-key or per-team token and dollar spend caps, and a dashboard grouped by model, provider, and user.agentgateway.dev · 2 Oct 2026
Integrations: The site lists model integrations including OpenAI, Anthropic, Gemini, Bedrock, Azure OpenAI, Mistral, DeepSeek, Ollama, Vertex AI, xAI, and Snowflake.agentgateway.dev · 2 Oct 2026
Deployment: The maker describes deployment options as a standalone binary, Docker, or Kubernetes.agentgateway.dev · 2 Oct 2026
Intended users: The site invites tool-builders, platform engineers, and AI enthusiasts to join the community and describes the controls as suited to platform teams.agentgateway.dev · 2 Oct 2026
Support: The enterprise page lists partner-provided commercial support, including a Solo.io offer with 24×7 coverage, upstream collaboration, and best-practice guidance.agentgateway.dev · 2 Oct 2026
Project stewardship: The enterprise page says agentgateway was originally created by Solo.io and is an AAIF project.agentgateway.dev · 2 Oct 2026