EVERYTHING XIAOMI
Get listed

Manifest

Manifest is an open-source LLM gateway for routing model requests, recovering from provider problems, and tracking inference spending.

Place
#1 of 33
Score
8.7
Manifest's website

What Manifest is

Manifest is an open-source LLM gateway for routing model requests, recovering from provider problems, and tracking inference spending. It offers one endpoint compatible with OpenAI and Anthropic for models and subscriptions, and can connect API keys, paid subscriptions, local models, and custom endpoints. When a provider is unavailable, Manifest can retry through another one. Its Autofix feature corrects malformed requests and resends them when retrying alone does not resolve the issue. The dashboard shows spending by harness, which models handled requests, and failures. Manifest is available in the cloud or as a self-hosted gateway. The self-hosted version runs with Docker, works offline, needs no account, and supports amd64 and arm64. The Cloud Free plan allows 10,000 routed requests per calendar month but cannot reach local models on the user's machine. Free includes unlimited self-hosting; Pro is $19 a month and includes unlimited routed requests on Manifest Cloud.

Good

  • Offers fallbacks when a provider goes down.
  • Autofix repairs malformed requests and resends them.
  • Self-hosted version works offline and needs no account.
  • Shows spending, models used, and request failures.

Watch out

  • Cloud Free is limited to 10,000 requests monthly.
  • Cloud Free cannot reach local models on the user's machine.
  • Cloud recordings are retained for 7 days on Free.
  • Pro is $19 a month.

Who it suits

Manifest suits AI builders, teams, startups, and platforms or providers that need to route model requests and track inference use. Self-hosting may suit users who want an offline gateway without an account.

Verdict

Manifest combines compatible request routing with fallbacks, Autofix, and usage visibility. Its cloud request cap and lack of local-model access on Free are important distinctions from self-hosting.

Plans and prices

From Manifest's own pricing page, checked 15 Oct 2026.

All about pricing
PlanPriceWhat it gives you
FreeFreeManifest Cloud or Docker self-hosted · MIT licence · unlimited agents · 10,000 routed Cloud requests/month · unlimited self-hosted requests · all providers · 7-day dashboard retention · Autofix · budget alerts · Discord community support · $0 /month
Pro$19 a monthHosted Manifest Cloud · unlimited routed requests · 365-day dashboard retention · basic support · single-user plan · $19 /month
EnterprisePriced on requestOn-premise, VPC or private cloud · multiple seats and team management · SSO/SAML · audit logs · custom retention · contractual uptime SLA · HIPAA and custom BAAs · custom guardrails · dedicated Slack and email support · Let's Talk

The facts

Each one read from Manifest's own pages, with the date it was checked.

What it does

API example
The documented chat endpoint is POST /v1/chat/completions with a harness key beginning mnfst_.checked 15 Oct 2026
Audience
Manifest says its gateway helps AI builders, teams and startups, and platforms or providers create reliable agents and workflows and manage inference consumption.checked 1 Oct 2026
Autofix
Autofix repairs malformed provider requests and resends them before the agent receives an error.checked 15 Oct 2026
Bring-your-own keys
Users can connect their own provider API keys and OAuth-backed subscriptions and pay providers directly.checked 15 Oct 2026
CLI
The documentation says the CLI can create harnesses, connect providers, configure routing and read request logs.checked 15 Oct 2026
Cloud limit
The Cloud Free plan includes 10,000 routed requests per calendar month and cannot reach local models running on the user's machine.checked 1 Oct 2026
Cloud limitation
The free Cloud plan is limited to 10,000 routed requests per calendar month and cannot reach local models running on the user's machine.checked 15 Oct 2026
Community integration
A GitHub issue author called the self-hosted router clean and effective for request-complexity routing and failover, including self-hosted models.checked 15 Oct 2026
Compliance
The Enterprise plan lists HIPAA and custom BAAs, SSO/SAML, audit logs, custom retention, and a contractual uptime SLA.checked 1 Oct 2026
Data residency
For the self-hosted version, routing and request data stay on the customer's servers except for documented telemetry and Autofix flows.checked 1 Oct 2026
Deployment options
Repository deployment guides cover Railway, Render, DigitalOcean, AWS, GCP, Fly.io, Coolify, Easypanel, Heroku, Koyeb and Apple Containers.checked 15 Oct 2026
Documentation depth
The documentation includes installation, first-request examples, provider setup, environment variables, CLI guidance and deployment paths.checked 15 Oct 2026
Enterprise compliance
Enterprise pricing lists SSO/SAML, audit logs, contractual uptime SLAs, HIPAA and custom business associate agreements.checked 15 Oct 2026
Fallbacks
Manifest automatically retries another provider when a selected provider fails.checked 15 Oct 2026
Independent praise: fallbacks
The same reviewer reported that automatic fallbacks kept an agent working during a provider outage.checked 15 Oct 2026
Independent praise: routing
An independent reviewer praised the transparent scoring, subscription routing, MIT licence and open dashboard after moving a personal agent stack to Manifest.checked 15 Oct 2026
Integrations
Manifest connects API keys, paid subscriptions, local models, and custom endpoints; named local integrations include Ollama, llama.cpp, and LM Studio.checked 1 Oct 2026
Licence
The repository publishes the software under the MIT licence.checked 15 Oct 2026
Limit: beta maturity
An independent review describes Manifest as beta software with breaking changes and recommends pinning Docker tags.checked 15 Oct 2026
Limit: database requirement
The review reports that PostgreSQL is required and SQLite support was not yet shipped.checked 15 Oct 2026
Limit: fallback tools
The review warns that a fallback model lacking the primary model's tool-schema support can fail tool-calling requests.checked 15 Oct 2026

The company

Company headquarters
LinkedIn lists Berkeley, California as Manifest's headquarters.checked 15 Oct 2026
Company size
LinkedIn lists Manifest as a 2–10 employee software-development company.checked 15 Oct 2026
Founded year
LinkedIn lists Manifest as founded in 2025.checked 15 Oct 2026

Alternatives to Manifest

All alternatives
  1. 1LangSmith logo

    LangSmith

    Free planWebAPILinuxmacOS
    8.6$39 usage-based
    Visit
  2. 2Bifrost logo

    Bifrost

    Free planOpen sourceWebAPILinuxmacOS
    8.3Free plan
    Visit
  3. 3

    LLM Gateway

    Free planOpen sourceWebAPIExtensionLinux
    8.2Free plan
    Visit
  4. 4

    Eden AI

    WebAPI
    8.1$5.50 one-time
    Visit
  5. 5

    TrueFoundry AI Gateway

    Free planWebAPILinuxSelf-hosted
    8.0From $499 a month
    Visit
  6. 6

    YoloRouter

    Free planOpen sourceWebAPILinuxmacOS
    7.8Free plan
    Visit