Promptfoo
7.8#2 in llm evaluation toolsFree planFree planWebAPILinuxmacOS
VisitPromptfoo vs PromptRAID
PromptRAID
5.7#21 in ai security testing toolsLinuxWindows
VisitWhat both publish
| Fact | Promptfoo | PromptRAID |
|---|---|---|
| Installation | Installation is available through npm, npx, Homebrew, and a project dependency; npm and npx require Node.js 22.22.0 or newer. | The README recommends installing the CLI with pipx and also documents installation in a Python virtual environment. |
| License | The open-source project is distributed under the MIT license. | PromptRAID is distributed under the MIT License, which permits use, copying, modification, distribution, sublicensing, and sale subject to its terms. |
| Model providers | Provider documentation covers OpenAI, Anthropic, Google, Vertex, HTTP, JavaScript, Python, Ruby, shell, OpenAI Agents, and other services. | The harness supports Anthropic, Gemini, Groq, Cerebras, and OpenRouter, including OpenAI-compatible endpoints. |
| Providers | The getting-started guide says Promptfoo supports 60+ providers, including OpenAI, Anthropic, Google, and local models such as Ollama. | The harness supports Anthropic, Gemini, Groq, Cerebras, and OpenRouter, including OpenAI-compatible endpoints. |
Promptfoo plans
- CommunityFree
- EnterprisePriced on request
- On-PremisePriced on request
PromptRAID plans
No prices published.
Pick Promptfoo if…
Promptfoo suits developers and enterprise teams evaluating prompts, model outputs, and AI application risks. Its local and self-hosted options may appeal to teams that want to run the Community plan on their own infrastructure.
Pick PromptRAID if…
It suits offensive security researchers and teams performing prompt-injection red-team exercises on LLM agents. Users should be comfortable with self-hosted command-line tools and provider credentials.