Manifest
8.7#1 in llm gatewaysFrom $19 a monthFree planWebAPILinuxSelf-hosted
Visit| Fact | Manifest | OpenZiti LLM Gateway |
|---|---|---|
| Integrations | Manifest connects API keys, paid subscriptions, local models, and custom endpoints; named local integrations include Ollama, llama.cpp, and LM Studio. | Documented backends include OpenAI, Anthropic, Ollama, vLLM, llama-server, and SGLang; clients use an OpenAI-compatible API. |
| Observability | Usage views show spending, selected models, token consumption and failed requests for each harness. | When enabled, Prometheus-exported metrics include request counts, latency, token counts, routing decisions, provider errors, and endpoint health. |
No prices published.
Manifest suits AI builders, teams, startups, and platforms or providers that need to route model requests and track inference use. Self-hosting may suit users who want an offline gateway without an account.
It suits teams needing a self-hosted gateway for model routing, provider translation, fallback, usage analytics, budget controls, or virtual keys. The project specifically addresses gateways, GPU servers behind NAT, and clients needing access without opening ports.