Traceloop
Traceloop monitors, debugs, and evaluates applications built with large language models.
What Traceloop is
Traceloop monitors, debugs, and evaluates applications built with large language models. It traces prompts, responses, latency, and related activity, then presents monitoring and evaluation dashboards. Built-in checks address faithfulness, relevance, and safety, while custom evaluators can be trained on your data. Evaluations may run on every pull request or in real time with thresholds for early issue detection. The Free Forever plan costs nothing and includes dashboards, CI/CD integration, and prompt management, with limits of 50,000 spans monthly, five seats, and 24-hour retention. Traceloop supports web, API, and self-hosted use, including cloud, on-premises, air-gapped, restricted, and Kubernetes deployments. OpenLLMetry is an open-source OpenTelemetry project whose traces can be exported to Traceloop or other observability systems. Documented integrations include OpenAI, Anthropic, Pinecone, Chroma, LangChain, LlamaIndex, and several observability platforms. Content tracing can be disabled while retaining metadata. Traceloop states SOC 2 and HIPAA compliance.
Good
- Free tier includes monitoring and evaluation dashboards
- Evaluations run in CI/CD or real time
- Custom evaluators can use your data
- OpenTelemetry-based OpenLLMetry is open source
- Content tracing can be disabled
Watch out
- Free tier retains data for 24 hours
- Free tier allows five seats
- Free tier caps spans at 50,000 monthly
Who it suits
It suits teams developing and operating LLM applications that need tracing, quality evaluation, and release checks. Self-hosted and restricted deployment options support controlled environments.
Verdict
Traceloop combines LLM observability, evaluations, and deployment flexibility, with an open-source instrumentation layer. Review span, seat, and retention limits before relying on the free plan.
Plans and prices
From Traceloop's own pricing page, checked 15 Oct 2026.
| Plan | Price | What it gives you |
|---|---|---|
| Free Forever | Free | 50K spans/month · 5 seats · 24-hour data retention · monitoring dashboard · evaluation dashboard · CI/CD integration · prompt management · $0 / mo |
| Enterprise | Priced on request | >50K spans/month · unlimited seats · custom retention · SOC 2 compliance · on-prem deployment · dedicated Slack support · Let's chat |
The facts
Each one read from Traceloop's own pages, with the date it was checked.
What it does
- Acquisition news
- ServiceNow said on May 5, 2026 that its recently completed Traceloop acquisition added runtime observability of AI-agent behavior to AI Control Tower.checked 15 Oct 2026
- CI/CD
- Standard and custom evaluations can run on pull requests to enforce quality thresholds before release.checked 15 Oct 2026
- Continuous monitoring
- Monitors run evaluators against matching production spans in real time and record results.checked 15 Oct 2026
- Custom evaluators
- Teams can annotate examples and train evaluators that score outputs against use-case-specific criteria.checked 15 Oct 2026
- Deployment
- Traceloop says it supports cloud, on-premises, air-gapped, and other restricted deployments, including Kubernetes environments.checked 3 Oct 2026
- Deployment options
- The self-hosting guide provides infrastructure-plus-applications and all-in-one Helm deployment approaches.checked 15 Oct 2026
- Documentation depth
- Documentation covers SDK setup, tracing, evaluators, experiments, monitoring, prompt management, API keys, projects, integrations and self-hosting.checked 15 Oct 2026
- Drift detection
- Traceloop is positioned to detect hallucinations, regressions and silent quality degradation in models and prompts.checked 15 Oct 2026
- Evaluations
- Traceloop describes built-in quality checks for faithfulness, relevance, and safety, and says users can train custom evaluators on their data.checked 3 Oct 2026
- Framework integrations
- Supported frameworks include LangChain, LlamaIndex, CrewAI, Haystack, LiteLLM, Agno and OpenAI Agents.checked 15 Oct 2026
- Funding
- The company’s About page names Y Combinator, Ibex Investors, Sorenson Capital, Samsung Next, Grand Ventures and other backers.checked 15 Oct 2026
- Independent listing description
- GetApp describes Traceloop as deployable through SaaS, on-premises or air-gapped environments with visibility into prompts, responses, latency, tokens and cost.checked 15 Oct 2026
- Integrations
- OpenLLMetry supports providers including OpenAI, Anthropic, Bedrock, Gemini, Cohere, Mistral, Ollama and Vertex AI.checked 15 Oct 2026
- Limit: product maturity
- A G2 reviewer said the product was still early and that some usability features needed improvement.checked 15 Oct 2026
- LLM-as-a-Judge
- Monitoring supports custom LLM-as-a-Judge evaluators driven by prompts describing semantic criteria.checked 15 Oct 2026
- Observability destinations
- The integrations catalog lists observability platforms including Datadog, Dynatrace, Honeycomb, New Relic, Sentry, Splunk, and ServiceNow Cloud Observability.checked 3 Oct 2026
- Open source
- OpenLLMetry is an open-source observability project built on OpenTelemetry, and its traces can be exported to Traceloop or another observability stack.checked 3 Oct 2026
- Open-source component
- OpenLLMetry is an OpenTelemetry-based observability project released under Apache License 2.0.checked 15 Oct 2026
- Praise: observability
- A G2 reviewer said Traceloop helped monitor LLM calls and troubleshoot bugs in advanced LLM queries.checked 15 Oct 2026
The company
- Company origin
- Y Combinator identifies Nir Gazit and Gal Kleinman as co-founders, places the company in its Winter 2023 batch and lists Tel Aviv-Yafo as its location.checked 15 Oct 2026
- Company profile
- LinkedIn lists Traceloop as privately held, founded in 2022, headquartered in San Francisco and employing 2–10 people.checked 15 Oct 2026
- Company update
- In a March 2026 post, Traceloop said it is joining ServiceNow and that OpenLLMetry will remain open source.checked 3 Oct 2026
Money
- Free tier limit
- The pricing page lists a 50,000-span monthly limit, five seats, and 24-hour data retention for Free Forever.checked 3 Oct 2026
Where it runs
- Independent platform listing
- GetApp lists web, Android and iPhone/iPad as supported platforms and identifies email, knowledge base, forum, chat and phone support options.checked 15 Oct 2026
Alternatives to Traceloop
- 1
W&B Weave
Free planOpen sourceiOSWebAPILinux8.7From $60 a month - 2
Opik
Free planOpen sourceWebAPILinuxmacOS8.4From $19 a month - 3
Langfuse
Free planOpen sourceWebAPILinuxSelf-hosted8.2From $29 a month - 4
LangWatch
Free planOpen sourceWebAPILinuxmacOS8.2From €29 a month - 5
Agenta
Free planOpen sourceWebAPISelf-hosted8.0From $29 a month - 6
LangSmith
Free planWebAPILinuxmacOS8.0$39 usage-based