TrueFoundry AI Gateway
TrueFoundry AI Gateway sits between applications and model providers, giving teams a single API for managing model access, routing, governance, security, obs…
What TrueFoundry AI Gateway is
TrueFoundry AI Gateway sits between applications and model providers, giving teams a single API for managing model access, routing, governance, security, observability, and cost controls. The API supports chat, completion, embedding, and reranking models. TrueFoundry says it connects with 1,000+ LLMs across 35+ platforms, including OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI, and Anthropic. Routing can use latency, weighted load balancing, or automatic fallback to a secondary model. Teams can track token use, latency, errors, and request volumes, and centrally store request and response logs. Rate limits, token or cost quotas, and role-based access controls help manage usage. The gateway also supports MCP connections to tools such as Slack, GitHub, Confluence, and Datadog. It is available as SaaS; Enterprise adds VPC, on-premises, and air-gapped deployment options. Developer is free, while Pro costs $25/user/mo; Enterprise pricing is custom.
Good
- One API supports four model types.
- Routing includes automatic fallback and weighted load balancing.
- Usage analytics cover tokens, latency, errors, and request volumes.
- Access controls include quotas, rate limits, and role-based permissions.
Watch out
- Developer is limited to 3 users and 10,000 requests per user monthly.
- Pro charges $20 per additional 100,000 requests.
- Enterprise pricing is custom and not listed.
Who it suits
It suits teams that need a shared gateway to manage model access, routing, usage, and governance. Enterprise deployment options may suit organizations that need VPC, on-premises, or air-gapped hosting.
Verdict
TrueFoundry AI Gateway brings model access, routing, observability, and usage controls into one layer. The free Developer plan has user and request limits, while Pro and Enterprise expand the listed allowances and deployment choices.
Plans and prices
From TrueFoundry AI Gateway's own pricing page, checked 15 Oct 2026.
| Plan | Price | What it gives you |
|---|---|---|
| Developer | Free | 3 users · universal API · model RBAC · virtual and self-hosted models · playground · Free |
| Pro | $499 a month | 10 users · 1M monthly requests · configurable routing · rate limiting · up to 25 MCP servers · $499/month |
| Pro Plus | $2,999 a month | 25 users · SSO · GDPR and HIPAA certificates · VPC and air-gapped deployment · data-lake export · $2,999/month |
| TrueFoundry Pro (AWS Marketplace) | $6,250 a month | Enterprise AI Gateway plan · additional AWS infrastructure costs may apply · 1-month contract |
| TrueFoundry Enterprise (AWS Marketplace) | $12,500 a month | Enterprise AI Gateway plan · additional AWS infrastructure costs may apply · 1-month contract |
| TrueFoundry On-Prem (AWS Marketplace) | $16,666.66 a month | On-premises AI Gateway plan · additional AWS infrastructure costs may apply · 1-month contract |
| Enterprise | Priced on request | 10M+ monthly requests · dedicated onboarding · enterprise SLAs · Contact Us |
The facts
Each one read from TrueFoundry AI Gateway's own pages, with the date it was checked.
What it does
- Access controls
- Teams can apply rate limits and cost or token quotas and use role-based access control to manage usage.checked 4 Oct 2026
- API authentication
- The metrics API accepts Personal Access Tokens or admin-created Virtual Account Tokens.checked 15 Oct 2026
- API surface
- The documentation exposes endpoints for chat, embeddings, reranking, responses, images, audio, batches, files, fine-tuning, moderation and model listing.checked 15 Oct 2026
- Configuration extensibility
- Gateway policies can be managed in the UI or declared in YAML and applied through the TrueFoundry CLI for GitOps workflows.checked 15 Oct 2026
- Deployment
- The gateway supports SaaS and, for Enterprise, VPC, on-premises and air-gapped deployment options.checked 4 Oct 2026
- Deployment options
- The product is offered as SaaS and can also run in a customer VPC, on premises or in an air-gapped environment.checked 15 Oct 2026
- Documentation depth
- The docs include provider catalogs, authentication, self-hosted model setup, metrics APIs and a large endpoint reference covering multiple media and model operations.checked 15 Oct 2026
- Funding
- TrueFoundry announced a $19 million Series A led by Intel Capital, bringing reported total funding to $21 million.checked 15 Oct 2026
- Guardrails
- Configurable input and output controls can filter PII, detect prompt injection, assess toxicity and apply organization-specific safety policies.checked 15 Oct 2026
- Limit: documentation and RBAC
- G2 reviewers mention documentation lag or insufficient onboarding detail, missing edge-case examples and requests for stronger RBAC or deployment approvals.checked 15 Oct 2026
- Limit: outage communication
- Gartner reviewers repeatedly ask TrueFoundry to communicate its own downtime more proactively.checked 15 Oct 2026
- Limit: pricing
- G2 pricing analysis reports that some small businesses and startups consider the paid tiers expensive, especially for enterprise and on-premises deployments.checked 15 Oct 2026
- MCP integrations
- Native MCP support connects tools such as Slack, GitHub, Confluence and Datadog, with OAuth2, RBAC and metadata policies on tool calls.checked 15 Oct 2026
- Microsoft Marketplace availability
- TrueFoundry AI Gateway is listed in Microsoft Marketplace as an Azure product for governed, observable AI-agent deployment.checked 15 Oct 2026
- Model coverage
- TrueFoundry says the gateway connects more than 1,600 models, while its provider documentation lists integrations across more than 35 platforms and over 1,000 LLMs.checked 15 Oct 2026
- Model providers
- TrueFoundry says the gateway integrates with 1,000+ LLMs across 35+ platforms, including OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI and Anthropic.checked 4 Oct 2026
- Notable news
- TrueFoundry announced TrueFailover in January 2026 to reroute enterprise AI traffic automatically during model-provider outages.checked 15 Oct 2026
- Observability
- Monitoring covers requests, tokens, cost, latency percentiles, time to first token, inter-token latency and request-level traces.checked 15 Oct 2026
- Praise: deployment and governance
- G2 reviewers praise one-click deployment, centralized infrastructure and governance, observability, routing and reduced DevOps work.checked 15 Oct 2026
The company
- Company
- TrueFoundry lists its address as Ensemble Labs Inc, 355 Bryant Street, Suite 403, San Francisco, California 94107.checked 4 Oct 2026
- Company size and location
- LinkedIn lists TrueFoundry as privately held, headquartered in San Francisco, with 51–200 employees and a 2021 founding year.checked 15 Oct 2026
- Founded
- TrueFoundry states it was founded in 2021 by Nikunj Bajaj, Abhishek Choudhary and Anuraag Gutgutia.checked 4 Oct 2026
- Headquarters
- San Francisco, California, United Stateschecked 23 Sep 2026
Money
- Cost controls
- Usage visibility, token tracking, quotas, budgets, rate limits, caching and batching are provided to control inference spend.checked 15 Oct 2026
Alternatives to TrueFoundry AI Gateway
- 1
Comet
Free planWebAPILinuxmacOS7.9From $19 a month - 2
DagsHub
Free planWebAPILinuxmacOS7.9From $99 a month - 3
ClearML
Free planWebAPILinuxmacOS7.4From $15 a month - 4
ZenML
Free planWebAPILinuxmacOS7.1From $999 a month - 5
MLRun
Free planWebAPILinuxmacOS6.6Free plan - 6
Hopsworks AI Lakehouse
Free planWebAPILinuxSelf-hosted6.4Free plan