DeepEval
8.3#1 in llm evaluation toolsFrom $200 a monthFree planWebAPILinuxmacOS
VisitDeepEval vs Exgentic
What both publish
| Fact | DeepEval | Exgentic |
|---|---|---|
| Integrations | Listed integrations include LangChain, Pydantic AI, OpenAI Agents, LangGraph, AWS AgentCore, Strands, Google ADK, LlamaIndex, and CrewAI. | The README documents API credentials for OpenAI and Anthropic models and support for Hugging Face models and Jobs. |
| License | The repository and package identify DeepEval as Apache Software License 2.0. | The framework is distributed under the Apache License 2.0. |
| Model integrations | Supported judge-model providers include OpenAI, Azure OpenAI, Ollama, OpenRouter, Anthropic, Bedrock, Gemini, DeepSeek, Vertex AI, Grok, Moonshot, Portkey, vLLM, LM Studio and LiteLLM. | The quick start documents OpenAI and Anthropic API credentials, and the repository also describes support for Hugging Face models or evaluations on Hugging Face Jobs. |
| Purpose | DeepEval is an open-source LLM evaluation framework for building evaluation pipelines to test AI systems. | Exgentic is an open agent leaderboard that evaluates general purpose AI agents across diverse domains. |
DeepEval plans
- DeepEvalFree
- FreeFree
- Starter$200 a month
- Team$2,000 a month
- EnterprisePriced on request
Exgentic plans
No prices published.
Pick DeepEval if…
DeepEval suits developers building repeatable AI evaluations in Python or CI/CD, especially those testing multiple modalities or agent workflows. Its free OS offering is for pre-production testing rather than production evaluation.
Pick Exgentic if…
Exgentic suits agent builders, researchers, component developers, benchmark builders, and others comparing agent behavior. It is useful for users comfortable with command-line or Python-based evaluation.