18.7
W&B Weave provides observability and continuous improvement tools for production AI agents.
Free planOpen sourceiOSWebAPI
Best LLM Monitoring in 2026
LLM monitoring tools help you inspect model activity through tracing, evaluation support, alerts, trace retention and provider coverage. Compare the checks and controls you need for your model workflows. Listed platform options include web, API, self-hosted, Linux, macOS and Windows. If you want to monitor work from a phone, check the service's Android support before choosing.
28.4
Opik helps teams building applications or agents that call an LLM log actions and evaluate behavior through development, testing, and production.
Free planOpen sourceWebAPILinux
38.2
Future AGI AI Evaluation SDK is an open-source platform for evaluating, optimizing, monitoring, and protecting AI agents.
Free planOpen sourceWebAPILinux
- 4
Langfuse
Langfuse is an open-source AI engineering platform for teams debugging, analyzing, and iterating on AI agent applications.
Free planOpen sourceWebAPILinuxSelf-hosted8.2From $29 a month - 5
LangWatch
LangWatch is an AI agent engineering platform for teams preparing agents for production.
Free planOpen sourceWebAPILinuxmacOS8.2From €29 a month - 6
Agenta
Agenta is an open-source workspace for teams to build, use, and automate AI coworkers.
Free planOpen sourceWebAPISelf-hosted8.0From $29 a month - 7
LangSmith
LangSmith is a platform for building, evaluating, deploying, monitoring, and improving AI agents.
Free planWebAPILinuxmacOS8.0$39 usage-based - 8
AgentOps
AgentOps is a developer platform for building AI agents and LLM applications.
Free planOpen sourceWebAPISelf-hosted7.8From $40 a month - 9
Braintrust
Braintrust is an observability platform for teams improving AI agents that run in production.
Free planWebAPISelf-hosted7.7From $249 a month - 10
OpenLIT
OpenLIT is an open-source Agent Harness Engineering platform for LLM tracing, evaluations, prompt management and cost tracking, built on OpenTelemetry.
Free planOpen sourceWebAPILinuxmacOS7.7Free plan - 11
Traceloop
Traceloop monitors, debugs, and evaluates applications built with large language models.
Free planOpen sourceWebAPISelf-hosted7.2Free plan - 12
TruLens
TruLens is a free, open-source Python SDK for tracing and evaluating AI agents, RAG applications, MCP apps, and summarization systems.
Free planOpen sourceAPISelf-hosted7.2Free plan - 13
Galileo
Galileo is an observability, evaluation, and guardrail platform for generative AI and agentic applications.
Free planWebAPISelf-hosted6.9From $100 a month - 14
Helicone
Helicone is a platform for routing, debugging, and analyzing AI applications.
Free planWebAPISelf-hosted6.9From $79 a month - 15
Arize AX
Arize AX is a platform for improving AI agents by turning production behavior into issues, investigations, evaluations, and experiments.
Free planWebAPISelf-hosted6.8From $50 a month - 16
Laminar
Laminar is an open-source observability and debugging platform for AI agents, designed around OpenTelemetry.
Free planWebAPISelf-hosted6.8From $30 a month - 17
Observe
Observe is an AI-powered observability platform that combines logs, metrics, and traces in a Snowflake lakehouse.
WebAPILinuxmacOS6.8 - 18
Portkey
Portkey is a platform for managing, observing, and governing generative AI across teams.
Free planWebAPISelf-hosted6.8From $49 a month - 19
HoneyHive
HoneyHive is an agent observability platform for teams that want to observe, evaluate, and improve AI agents in production.
Free planWebAPISelf-hosted6.4Free plan - 20
Arize Phoenix
Arize Phoenix helps teams trace, evaluate, debug, and improve AI applications.
Free planWebAPISelf-hosted6.3Free plan - 21
Cognifity Verdict
WebLinuxmacOSWindows5.0 - 224.6
- 23
Athina
Web4.6 - 244.6
- 254.6
Choosing well
Check plans and entry costs
A free plan is available from listed tools, while other services offer a free trial instead. Check the plan details before moving a monitoring workflow.
Compare the paid-from price where it is published. Examples include Agenta from $29 per month, AgentOps from $40 per month and Braintrust from $249 per month.
Match tracing with evaluation needs
Use the LLM tracing and evaluation support fields to match a tool with the checks you need. Trace retention and alerts matter when you need to review activity over time or react to issues.
Review how the tool handles the model providers in your workflow before committing to a plan.
Choose a deployment style
The listed deployment choices include web, API and self-hosted setups, with Linux, macOS and Windows also represented. Pick the access pattern that fits your team and infrastructure.
An Android app is not identified in the platform facts, so verify phone access separately if that matters to you.
Review code and documentation
Open-source code is available from listed tools. If you need to read or change the code, check the licence and the project's documentation before choosing.
Freshness is part of the ranking basis, so look for current product details when comparing capabilities and pricing.
Questions people ask
What does an LLM monitoring tool track?
These tools can provide LLM tracing, evaluations, alerts, trace retention and LLM provider coverage. Compare the fields that fit your workflow.
Can I start with a free plan?
A free plan is offered by listed tools. Other products list a free trial or paid pricing, so check the plan details for the service you want.
Which deployment options are available?
Listed options include web, API and self-hosted deployment, plus Linux, macOS and Windows platforms.
How should I compare prices?
Check whether a free plan or trial is available, then compare the published paid-from price. Pricing may be listed as a monthly amount, annual rate or on request.