Manifest
8.7#1 in llm gatewaysFrom $19 a monthFree planWebAPILinuxSelf-hosted
Visit
| Fact | Manifest | TensorZero |
|---|---|---|
| Integrations | Manifest connects API keys, paid subscriptions, local models, and custom endpoints; named local integrations include Ollama, llama.cpp, and LM Studio. | Documented providers include Anthropic, AWS Bedrock, Azure, Google, OpenAI, OpenRouter, Together AI, vLLM, and OpenAI-compatible endpoints. |
| Observability | Usage views show spending, selected models, token consumption and failed requests for each harness. | TensorZero can store inference and feedback data for observability, optimization, evaluations, and experimentation in Postgres or ClickHouse. |
| Product | Manifest is an open-source LLM gateway that routes requests, provides fallbacks, repairs failing requests with Autofix, and tracks spending. | TensorZero is described in its documentation as an open-source stack combining an LLM gateway, observability, optimization, evaluation, and experimentation. |
| Security | Manifest states that data in transit uses TLS, passwords are hashed, and Gateway provider credentials are encrypted with AES-256-GCM. | TensorZero's privacy policy says it uses physical, technical, organizational, and administrative security measures to protect personal data. |
Manifest suits AI builders, teams, startups, and platforms or providers that need to route model requests and track inference use. Self-hosting may suit users who want an offline gateway without an account.
TensorZero suits teams that want a self-hosted gateway and data tools for LLM applications, with routing, evaluation, and experimentation. It is a poor fit for teams that require an actively maintained project.