18.7
W&B Weave provides observability and continuous improvement tools for production AI agents.
Free planOpen sourceiOSWebAPI
Alternatives to Future AGI AI Evaluation SDK
Future AGI AI Evaluation SDK brings evaluation, simulation, tracing, and monitoring together for teams building and operating AI agents. Its evaluation options span heuristic, code, LLM-as-judge, and agentic methods, with templates and CI/CD support. It also traces LLM calls, tools, retrieval, and chain steps, and offers text and voice simulations with personas and scenarios. Self-hosting and enterprise deployment choices suit teams with deployment or data-location…
28.4
Opik helps teams building applications or agents that call an LLM log actions and evaluate behavior through development, testing, and production.
Free planOpen sourceWebAPILinux
38.2
Langfuse is an open-source AI engineering platform for teams debugging, analyzing, and iterating on AI agent applications.
Free planOpen sourceWebAPILinux
- 4
LangWatch
LangWatch is an AI agent engineering platform for teams preparing agents for production.
Free planOpen sourceWebAPILinuxmacOS8.2From €29 a month - 5
Agenta
Agenta is an open-source workspace for teams to build, use, and automate AI coworkers.
Free planOpen sourceWebAPISelf-hosted8.0From $29 a month - 6
LangSmith
LangSmith is a platform for building, evaluating, deploying, monitoring, and improving AI agents.
Free planWebAPILinuxmacOS8.0$39 usage-based - 7
AgentOps
AgentOps is a developer platform for building AI agents and LLM applications.
Free planOpen sourceWebAPISelf-hosted7.8From $40 a month - 8
Braintrust
Braintrust is an observability platform for teams improving AI agents that run in production.
Free planWebAPISelf-hosted7.7From $249 a month - 9
OpenLIT
OpenLIT is an open-source Agent Harness Engineering platform for LLM tracing, evaluations, prompt management and cost tracking, built on OpenTelemetry.
Free planOpen sourceWebAPILinuxmacOS7.7Free plan - 10
Traceloop
Traceloop monitors, debugs, and evaluates applications built with large language models.
Free planOpen sourceWebAPISelf-hosted7.2Free plan - 11
TruLens
TruLens is a free, open-source Python SDK for tracing and evaluating AI agents, RAG applications, MCP apps, and summarization systems.
Free planOpen sourceAPISelf-hosted7.2Free plan - 12
Galileo
Galileo is an observability, evaluation, and guardrail platform for generative AI and agentic applications.
Free planWebAPISelf-hosted6.9From $100 a month - 13
Helicone
Helicone is a platform for routing, debugging, and analyzing AI applications.
Free planWebAPISelf-hosted6.9From $79 a month - 14
Arize AX
Arize AX is a platform for improving AI agents by turning production behavior into issues, investigations, evaluations, and experiments.
Free planWebAPISelf-hosted6.8From $50 a month - 15
Laminar
Laminar is an open-source observability and debugging platform for AI agents, designed around OpenTelemetry.
Free planWebAPISelf-hosted6.8From $30 a month - 16
Observe
Observe is an AI-powered observability platform that combines logs, metrics, and traces in a Snowflake lakehouse.
WebAPILinuxmacOS6.8 - 17
Portkey
Portkey is a platform for managing, observing, and governing generative AI across teams.
Free planWebAPISelf-hosted6.8From $49 a month - 18
HoneyHive
HoneyHive is an agent observability platform for teams that want to observe, evaluate, and improve AI agents in production.
Free planWebAPISelf-hosted6.4Free plan - 19
Arize Phoenix
Arize Phoenix helps teams trace, evaluate, debug, and improve AI applications.
Free planWebAPISelf-hosted6.3Free plan - 20
Cognifity Verdict
WebLinuxmacOSWindows5.0 - 214.6
- 22
Athina
Web4.6 - 234.6
- 244.6
- 254.3