DeepEval
8.3#1 in llm evaluation toolsFrom $200 a monthFree planWebAPILinuxmacOS
VisitDeepEval vs Promptfoo
What both publish
| Fact | DeepEval | Promptfoo |
|---|---|---|
| Company size | LinkedIn lists Confident AI as a privately held software company with 11–50 employees and San Francisco headquarters. | LinkedIn lists Promptfoo as a privately held software-development company with 11–50 employees. |
| Headquarters | San Francisco, California, United States | Promptfoo identifies San Francisco, California as its base and headquarters. |
| Integrations | Listed integrations include LangChain, Pydantic AI, OpenAI Agents, LangGraph, AWS AgentCore, Strands, Google ADK, LlamaIndex, and CrewAI. | Documented integrations include LangChain, LangGraph, CrewAI, MCP, Splunk, Burp Suite, GitHub Actions, GitLab, Jenkins, CircleCI, Azure Pipelines, and Bitbucket Pipelines. |
| License | The repository and package identify DeepEval as Apache Software License 2.0. | The open-source project is distributed under the MIT license. |
| Model providers | Evaluation model integrations include OpenAI, Azure OpenAI, Ollama, OpenRouter, Anthropic, Amazon Bedrock, Gemini, DeepSeek, Vertex AI, Grok, Moonshot, Portkey, vLLM, LM Studio, and LiteLLM. | Provider documentation covers OpenAI, Anthropic, Google, Vertex, HTTP, JavaScript, Python, Ruby, shell, OpenAI Agents, and other services. |
| Rating on G2 | 4.6 out of 5 from 5 reviews | 0 out of 5 from 0 reviews. |
| Release activity | The public changelog records frequent releases, feature additions, bug fixes and breaking changes by year. | January 2026 release notes list adaptive rate limiting, Transformers.js local inference, telecom red-team plugins, video-generation providers, and a VS Code extension. |
DeepEval plans
- DeepEvalFree
- FreeFree
- Starter$200 a month
- Team$2,000 a month
- EnterprisePriced on request
Promptfoo plans
- CommunityFree
- EnterprisePriced on request
- On-PremisePriced on request
Pick DeepEval if…
DeepEval suits developers building repeatable AI evaluations in Python or CI/CD, especially those testing multiple modalities or agent workflows. Its free OS offering is for pre-production testing rather than production evaluation.
Pick Promptfoo if…
Promptfoo suits developers and enterprise teams evaluating prompts, model outputs, and AI application risks. Its local and self-hosted options may appeal to teams that want to run the Community plan on their own infrastructure.