OpenLLMetry
OpenLLMetry is free, Apache-2.0 software for monitoring and debugging LLM application execution.
What OpenLLMetry is
OpenLLMetry is free, Apache-2.0 software for monitoring and debugging LLM application execution. It adds non-intrusive tracing through OpenTelemetry and can export traces to Traceloop or an observability stack already in use. Workflow annotations describe workflows, tasks, agents, and tools. SDK guides cover Python, JavaScript/TypeScript, Go, and Ruby. Supported providers include OpenAI, Anthropic, Amazon Bedrock, and Google Gemini, while supported frameworks include LangChain, LlamaIndex, CrewAI, Haystack, and OpenAI Agents; language availability varies. Integrations include Datadog, Dynatrace, Honeycomb, New Relic, Sentry, Splunk, and OpenTelemetry Collector. Prompts, completions, and embeddings are logged by default, with an option to disable content logging. Traces can cover LLM, agent, retrieval, and multimodal activity, although multimodal visualization requires Traceloop and media over 10MB may be truncated or linked. It supports self-hosted and web/API deployment, including restricted environments.
Good
- Free Apache-2.0 software
- Supports multiple LLM providers
- Integrates with observability backends
- Tracks LLM, agent, and retrieval activity
- Offers self-hosted deployment
Watch out
- Multimodal visualization requires Traceloop
- Media over 10MB may be truncated
- Content logging is enabled by default
- Free Forever limits spans, seats, and retention
Who it suits
It suits teams building LLM applications that need tracing, token-cost tracking, or debugging across providers and frameworks. Self-hosting options fit organizations with on-premise or restricted deployments.
Verdict
OpenLLMetry provides broad tracing and integration coverage for LLM applications without a license fee. Check its multimodal visualization requirement and Free Forever limits against your deployment needs.
Plans and prices
From OpenLLMetry's own pricing page, checked 8 Oct 2026.
| Plan | Price | What it gives you |
|---|---|---|
| Enterprise | Priced on request | >50K spans / month · Unlimited Seats · Custom Data Retention · SOC 2 Compliance · On-prem deployment option · Dedicated slack support · Let's chat |
| Free Forever | — | Up to 50K spans / month · Up to 5 Seats · 24 Hours Data Retention · Monitoring Dashboard · Evaluation Dashboard · CI/CD integration · Prompt Management |
The facts
Each one read from OpenLLMetry's own pages, with the date it was checked.
What it does
- Backend integrations
- The integration catalog includes Datadog, Dynatrace, Honeycomb, New Relic, Sentry, Splunk, and OpenTelemetry Collector.checked 8 Oct 2026
- Content logging
- OpenLLMetry logs prompts, completions, and embeddings by default, and content logging can be disabled with TRACELOOP_TRACE_CONTENT=false.checked 8 Oct 2026
- Export destinations
- Traces can be exported to Traceloop or an existing observability stack.checked 8 Oct 2026
- Framework support
- The supported framework list includes LangChain, LlamaIndex, CrewAI, Haystack, and OpenAI Agents, with language support varying by framework.checked 8 Oct 2026
- Languages
- The documentation provides SDK getting-started guides for Python, JavaScript/TypeScript, Go, and Ruby.checked 8 Oct 2026
- License
- The pricing page says OpenLLMetry is Apache-2.0 licensed and free to use.checked 8 Oct 2026
- Multi-modal size limit
- The documentation says very large media files over 10MB may be truncated or linked rather than embedded.checked 8 Oct 2026
- Multi-modal tracing
- Multi-modal tracing can capture images, audio, video, documents, and mixed content; its visualization is currently available only with Traceloop as the observability backend.checked 8 Oct 2026
- Provider support
- The supported list includes OpenAI, Anthropic, Amazon Bedrock, Google Gemini, and other LLM providers, with Python and TypeScript support varying by provider.checked 8 Oct 2026
- Purpose
- OpenLLMetry is an open source project for monitoring and debugging LLM app execution, with non-intrusive tracing built on OpenTelemetry.checked 8 Oct 2026
- Self-hosting
- Traceloop says it supports on-premise deployment in AWS, GCP, Azure, Kubernetes, air-gapped, and other restricted environments.checked 8 Oct 2026
- Support
- The Enterprise plan includes dedicated Slack support.checked 8 Oct 2026
- Tracing features
- Workflow annotations can describe workflows, tasks, agents, and tools in traces.checked 8 Oct 2026
Alternatives to OpenLLMetry
- 1
W&B Weave
Free planOpen sourceiOSWebAPILinux8.7From $60 a month - 2
Opik
Free planOpen sourceWebAPILinuxmacOS8.4From $19 a month - 3
Evidently AI
Free planOpen sourceWebAPILinuxmacOS8.3From $80 a month - 4
Langfuse
Free planOpen sourceWebAPILinuxSelf-hosted8.2From $29 a month - 5
LangWatch
Free planOpen sourceWebAPILinuxmacOS8.2From €29 a month - 6
LangSmith
Free planWebAPILinuxmacOS8.0$39 usage-based