18.7
W&B Weave provides observability and continuous improvement tools for production AI agents.
Free planOpen sourceiOSWebAPI
Alternatives to VRUNAI
28.4
Opik helps teams building applications or agents that call an LLM log actions and evaluate behavior through development, testing, and production.
Free planOpen sourceWebAPILinux
38.3
DeepEval is a free, open-source framework for creating evaluation pipelines that test AI systems.
Free planOpen sourceWebAPILinux
- 4
Future AGI AI Evaluation SDK
Future AGI AI Evaluation SDK is an open-source platform for evaluating, optimizing, monitoring, and protecting AI agents.
Free planOpen sourceWebAPILinuxmacOS8.2From $250 a month - 5
LangWatch
LangWatch is an AI agent engineering platform for teams preparing agents for production.
Free planOpen sourceWebAPILinuxmacOS8.2From €29 a month - 6
LangSmith
LangSmith is a platform for building, evaluating, deploying, monitoring, and improving AI agents.
Free planWebAPILinuxmacOS8.0$39 usage-based - 7
Promptfoo
Promptfoo helps developers and enterprises evaluate prompts and test AI applications for security risks.
Free planOpen sourceWebAPILinuxmacOS7.8Free plan - 8
Braintrust
Braintrust is an observability platform for teams improving AI agents that run in production.
Free planWebAPISelf-hosted7.7From $249 a month - 9
Giskard
Giskard is a freemium platform for finding security and quality problems in AI agents before production use.
Free planOpen sourceWebAPILinuxSelf-hosted7.6Free plan - 10
TruLens
TruLens is a free, open-source Python SDK for tracing and evaluating AI agents, RAG applications, MCP apps, and summarization systems.
Free planOpen sourceAPISelf-hosted7.2Free plan - 11
Maxim AI
Maxim AI is an evaluation and observability platform for simulating, assessing, and monitoring AI agents.
Free planWebAPISelf-hosted7.0From $29 a month - 12
Galileo
Galileo is an observability, evaluation, and guardrail platform for generative AI and agentic applications.
Free planWebAPISelf-hosted6.9From $100 a month - 13
Parea AI
Parea AI is a platform for experiment tracking, observability, and human annotation for teams building LLM applications for production.
Free planWebAPISelf-hosted6.8From $150 a month - 14
Noveum
Noveum is an AI agent evaluation platform for teams operating production chat, voice, and workflow agents.
Free planWebAPILinuxSelf-hosted6.7From $69 a month - 15
AgentClash
AgentClash is an open-source platform for evaluating AI agents on real tasks in a sandbox.
Free planWebAPISelf-hosted6.6From $49 a month - 16
Arklex
Arklex helps teams validate AI agents by creating scenarios, simulating multi-turn conversations, and evaluating responses.
Free planAPILinuxSelf-hosted6.4Free plan - 17
HoneyHive
HoneyHive is an agent observability platform for teams that want to observe, evaluate, and improve AI agents in production.
Free planWebAPISelf-hosted6.4Free plan - 18
Strands Evals
Strands Evals is an open-source Python SDK and CLI for evaluating AI agent behavior during development and after deployment.
Free planAPILinuxmacOSSelf-hosted6.2Free plan - 19
Google Cloud Agent Evaluation
Google Cloud Agent Evaluation helps measure and improve AI agents’ performance, safety, and quality.
Free planWebAPI6.1Free plan - 20
MLflow GenAI Evaluation
MLflow GenAI Evaluation helps teams assess and monitor LLM applications and AI agents through development and production.
Free planWebAPISelf-hosted6.1Free plan - 21
Tangle
Tangle runs AI agents in isolated Linux sandboxes and records their work for people to review before approving changes.
Free planWebAPILinux6.1Free plan - 22
Benchboard
Web6.0From $39 a month - 23
OpenAgent Eval
OpenAgent Eval is a free, open-source framework for evaluating retrieval-augmented generation systems and AI agents.
APILinuxmacOSSelf-hosted5.9 - 24
Exgentic
Exgentic is an open-source leaderboard and evaluation framework for comparing general-purpose AI agents.
WebAPILinuxSelf-hosted5.8 - 25
Inspect AI
Inspect AI is a free, open-source framework for evaluating large language models across coding, agent tasks, reasoning, knowledge, behavior and multimodal understanding.
Free planAPIExtension5.8Free plan - 26
5.6From $0.01 a month - 27
Sensei
API5.2