
Bifrost
7.6#3 in llm gateway softwareFree planFree planWebAPILinuxmacOS
Visit
| Fact | Bifrost | OpenZiti LLM Gateway |
|---|---|---|
| Deployment | Bifrost can run as a self-hosted binary or through npx, Docker and Kubernetes, including private-cloud and disconnected environments. | The project describes deployment as one Go binary and one YAML file, with no database, message queue, or sidecar required. |
| Intended users | The OSS edition is presented for developers, small teams, and self-managed deployments, while Enterprise is for teams running production AI systems at scale. | The README describes routing across local inference servers and remote providers, including GPU servers behind NAT and clients using OpenAI-compatible libraries. |
| Observability | Built-in observability includes OpenTelemetry support and a dashboard for request monitoring. | When enabled, Prometheus-exported metrics include request counts, latency, token counts, routing decisions, provider errors, and endpoint health. |
No prices published.
The OSS edition suits developers and small teams that can manage a self-hosted deployment. Enterprise targets teams running production AI systems at scale and needing additional controls or SLA-backed support.
It suits teams needing a self-hosted gateway for model routing, provider translation, fallback, usage analytics, budget controls, or virtual keys. The project specifically addresses gateways, GPU servers behind NAT, and clients needing access without opening ports.