EVERYTHING XIAOMI
Get listed
Side by side

Promptfoo vs RedForge

Promptfoo logo

Promptfoo

7.8#2 in llm evaluation toolsFree plan
Free planWebAPILinuxmacOS
Visit

RedForge

6.1#13 in ai security testing toolsFree plan
Free planAPILinuxSelf-hosted
Visit

What both publish

FactPromptfooRedForge
DeploymentThe Community plan can run locally or be self-hosted, while Enterprise includes managed cloud deployment and On-Premise supports deployment on the customer’s infrastructure.The Docker instructions say the container runs as non-root user redforge (UID 1001) with a read-only filesystem.
IntegrationsDocumented integrations include LangChain, LangGraph, CrewAI, MCP, Splunk, Burp Suite, GitHub Actions, GitLab, Jenkins, CircleCI, Azure Pipelines, and Bitbucket Pipelines.It can export SARIF for GitHub Code Scanning and documents a GitHub Actions workflow that uploads the SARIF file.
LicenseThe open-source project is distributed under the MIT license.The project is released under the Apache 2.0 license, and the README says probe payloads are released under CC0.
Model providersProvider documentation covers OpenAI, Anthropic, Google, Vertex, HTTP, JavaScript, Python, Ruby, shell, OpenAI Agents, and other services.It lists adapters for OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, Ollama, HuggingFace, and generic REST endpoints.
ProvidersThe getting-started guide says Promptfoo supports 60+ providers, including OpenAI, Anthropic, Google, and local models such as Ollama.The README lists provider adapters for OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, Ollama, HuggingFace, and generic REST endpoints.

Promptfoo plans

  • CommunityFree
  • EnterprisePriced on request
  • On-PremisePriced on request

RedForge plans

  • RedForgeFree

Pick Promptfoo if…

Promptfoo suits developers and enterprise teams evaluating prompts, model outputs, and AI application risks. Its local and self-hosted options may appeal to teams that want to run the Community plan on their own infrastructure.

Pick RedForge if…

RedForge suits teams that need self-hosted LLM security testing with configurable probes, compliance reports, or CI integration. It is for authorized use, and its CLI requires an authorization value.

Charts they share