
Promptfoo
7.8#2 in llm evaluation toolsFree planFree planWebAPILinuxmacOS
Visit
| Fact | Promptfoo | RedForge |
|---|---|---|
| Deployment | The Community plan can run locally or be self-hosted, while Enterprise includes managed cloud deployment and On-Premise supports deployment on the customer’s infrastructure. | The Docker instructions say the container runs as non-root user redforge (UID 1001) with a read-only filesystem. |
| Integrations | Documented integrations include LangChain, LangGraph, CrewAI, MCP, Splunk, Burp Suite, GitHub Actions, GitLab, Jenkins, CircleCI, Azure Pipelines, and Bitbucket Pipelines. | It can export SARIF for GitHub Code Scanning and documents a GitHub Actions workflow that uploads the SARIF file. |
| License | The open-source project is distributed under the MIT license. | The project is released under the Apache 2.0 license, and the README says probe payloads are released under CC0. |
| Model providers | Provider documentation covers OpenAI, Anthropic, Google, Vertex, HTTP, JavaScript, Python, Ruby, shell, OpenAI Agents, and other services. | It lists adapters for OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, Ollama, HuggingFace, and generic REST endpoints. |
| Providers | The getting-started guide says Promptfoo supports 60+ providers, including OpenAI, Anthropic, Google, and local models such as Ollama. | The README lists provider adapters for OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, Ollama, HuggingFace, and generic REST endpoints. |
Promptfoo suits developers and enterprise teams evaluating prompts, model outputs, and AI application risks. Its local and self-hosted options may appeal to teams that want to run the Community plan on their own infrastructure.
RedForge suits teams that need self-hosted LLM security testing with configurable probes, compliance reports, or CI integration. It is for authorized use, and its CLI requires an authorization value.