EVERYTHING XIAOMI
Get listed
Side by side

Augustus vs Promptfoo

Augustus

6.1#11 in ai security testing toolsFree plan
Free planLinuxmacOSSelf-hostedWindows
Visit
Promptfoo logo

Promptfoo

7.8#2 in llm evaluation toolsFree plan
Free planWebAPILinuxmacOS
Visit

What both publish

FactAugustusPromptfoo
Founded20102024
HeadquartersAustin, Texas, United StatesPromptfoo identifies San Francisco, California as its base and headquarters.
LicenseThe repository identifies Augustus as licensed under Apache 2.0.The open-source project is distributed under the MIT license.
ProvidersIt supports 28 LLM provider categories with 43 generator variants, including OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Ollama, and custom REST endpoints.The getting-started guide says Promptfoo supports 60+ providers, including OpenAI, Anthropic, Google, and local models such as Ollama.

Augustus plans

  • AugustusFree

Promptfoo plans

  • CommunityFree
  • EnterprisePriced on request
  • On-PremisePriced on request

Pick Augustus if…

Augustus is for security professionals who need to scan language models for vulnerabilities. It suits teams able to install and run a self-hosted Go tool and test only with authorization.

Pick Promptfoo if…

Promptfoo suits developers and enterprise teams evaluating prompts, model outputs, and AI application risks. Its local and self-hosted options may appeal to teams that want to run the Community plan on their own infrastructure.

Charts they share