PromptWorks
PromptWorks is a free, Apache-2.0 open-source workspace for teams managing prompts, testing them in batches, and improving them with AI assistance.
What PromptWorks is
PromptWorks is a free, Apache-2.0 open-source workspace for teams managing prompts, testing them in batches, and improving them with AI assistance. Users can create prompt versions, add tags, record authorship, keep audit records, and compare changes. Batch evaluations run across prompt versions, models, parameter sets, and test samples, with progress and result comparisons. Outputs receive scores from 0 to 100 for dimensions such as accuracy, completeness, clarity, and stability. Those results can drive suggested rewrites, model or parameter advice, and validation plans, with rewritten drafts saved as new versions. PromptWorks also manages model providers, configurations, and invocation records for model selection, cost review, and A/B experiments. OpenAI and Anthropic API keys are named integrations. The project supports web use, self-hosting, APIs, and Docker Compose deployment with PostgreSQL and Redis, including Linux AMD64 and ARM64 images.
Good
- Scores outputs across several quality dimensions
- Batch tests compare versions, models, and parameters
- Prompt history includes tags, authorship, and audits
- Supports web, API, and self-hosted deployment
- Apache-2.0 open-source license
Watch out
- Deployment requires PostgreSQL and Redis for production
- Setup involves Docker Compose or local source configuration
Who it suits
It suits teams maintaining shared prompt libraries, regression tests, model comparisons, parameter tuning, and internal business assistants. Technical users can deploy it through Docker Compose or local source setup.
Verdict
PromptWorks provides a structured prompt lifecycle with testing, scoring, version comparison, and model records. Its open-source, self-hosted approach fits teams that can manage the documented infrastructure and want API access.
The facts
Each one read from PromptWorks's own pages, with the date it was checked.
What it does
- AI scoring
- It scores test outputs on a 0–100 scale across dimensions such as accuracy, completeness, clarity, and stability.checked 4 Oct 2001
- API
- The backend exposes endpoints including /api/v1/prompts, /api/v1/prompt-test, and /api/v1/llms.checked 5 Oct 2001
- Batch testing
- It supports repeated evaluation runs across prompt versions, models, parameter sets, and test samples, with result comparison and progress tracking.checked 5 Oct 2001
- Data components
- The documented default database is PostgreSQL, and Redis is used for caching or asynchronous tasks.checked 5 Oct 2001
- Deployment
- The project documents Docker Compose deployment with a frontend, backend, PostgreSQL, and Redis.checked 5 Oct 2001
- Integrations
- The setup documentation names OpenAI and Anthropic API keys for integrating those models.checked 5 Oct 2001
- Intended users
- The maker describes use cases including team prompt asset management, prompt regression testing, model selection, parameter tuning, and internal business assistants.checked 4 Oct 2001
- License
- The GitHub repository identifies its license as Apache-2.0.checked 5 Oct 2001
- Model monitoring
- It centrally manages model providers, model configuration, and invocation records for model selection, cost review, and A/B experiments.checked 4 Oct 2001
- Optimization
- It can generate prompt rewrites, parameter and model suggestions, and validation plans from scoring results.checked 5 Oct 2001
- Prompt lifecycle
- It supports prompt creation, version iteration, tags, authorship tracking, and audit records.checked 4 Oct 2001
- Prompt scoring
- It scores test outputs on a 0–100 scale and shows dimensions such as accuracy, completeness, clarity, and stability.checked 5 Oct 2001
- Purpose
- PromptWorks is a prompt management, batch evaluation, and AI-assisted optimization workspace for teams.checked 5 Oct 2001
- Security and trust
- The README describes prompt change audit records and configurable CORS origins; it does not state a security certification or compliance standard.checked 5 Oct 2001
- Self-hosting
- The maker documents running the application locally from source and provides Docker images for the backend and frontend.checked 5 Oct 2001
- Support
- The project invites users to submit issues and suggestions through GitHub.checked 5 Oct 2001
- Use cases
- The maker describes use cases including team prompt libraries, regression testing, model selection, parameter tuning, and quality review.checked 5 Oct 2001
- Version comparison
- Users can review version differences and save rewritten drafts as new prompt versions.checked 4 Oct 2001
- Version management
- It supports prompt versions, tags, authorship information, audit records, and version comparisons.checked 5 Oct 2001
Where it runs
- Platform support
- Published Docker images are described as supporting linux/amd64 and linux/arm64 architectures.checked 4 Oct 2001
Alternatives to PromptWorks
- 1
Vellum
Free planOpen sourceAndroidiOSWebAPI8.7From $30 a month - 2
Langfuse
Free planOpen sourceWebAPILinuxSelf-hosted8.1From $29 a month - 3
PromptHelm
Free planAndroidiOSWebAPI8.0From $39 a month - 4
Agenta
Free planOpen sourceWebAPISelf-hosted7.9From $29 a month - 5
Promptfoo
Free planOpen sourceWebAPILinuxmacOS7.8Free plan - 6
Braintrust
Free planWebAPISelf-hosted7.6From $249 a month