Promptfoo
7.8#2 in llm evaluation toolsFree planFree planWebAPILinuxmacOS
VisitPromptfoo vs RAGChecker
RAGChecker
5.8#19 in llm evaluation toolsFree planFree planSelf-hosted
VisitWhat both publish
| Fact | Promptfoo | RAGChecker |
|---|---|---|
| Installation | Installation is available through npm, npx, Homebrew, and a project dependency; npm and npx require Node.js 22.22.0 or newer. | The maker documents installation with pip install ragchecker and requires downloading the spaCy en_core_web_sm model in its quick start. |
| License | The open-source project is distributed under the MIT license. | The project is licensed under Apache-2.0. |
Promptfoo plans
- CommunityFree
- EnterprisePriced on request
- On-PremisePriced on request
RAGChecker plans
- RAGCheckerFree
Pick Promptfoo if…
Promptfoo suits developers and enterprise teams evaluating prompts, model outputs, and AI application risks. Its local and self-hosted options may appeal to teams that want to run the Community plan on their own infrastructure.
Pick RAGChecker if…
It suits developers and teams evaluating self-hosted RAG applications that need retrieval and generation diagnostics. Users should be comfortable installing Python packages and supplying annotated evaluation data.