Vellum describes itself as a personal AI assistant that can read files, manage calendars, send email, run code, and control a computer.
Alternatives to PromptMetrics
Langfuse is an open-source AI engineering platform for teams debugging, analyzing, and iterating on AI agent applications.
PromptHelm is a prompt management platform for engineering teams that build with large language models.
- 4

Agenta
Agenta is an open-source workspace for teams to build, use, and automate AI coworkers.
Free planOpen sourceWebAPISelf-hosted7.9From $29 a month - 5

Promptfoo
Promptfoo helps developers and enterprises evaluate prompts and test AI applications for security risks.
Free planOpen sourceWebAPILinuxmacOS7.8Free plan - 6

Braintrust
Braintrust is an observability platform for teams improving AI agents that run in production.
Free planWebAPISelf-hosted7.6From $249 a month - 7

Maxim AI
Maxim AI is an evaluation and observability platform for simulating, assessing, and monitoring AI agents.
Free planWebAPISelf-hosted7.0From $29 a month - 8

PromptLayer
PromptLayer is a platform for teams that build and improve AI products.
Free planWebAPISelf-hosted6.9From $49 a month - 9

PromptHub
PromptHub is a community-driven platform for discovering, managing, versioning, testing and deploying prompts.
Free planWebAPI6.7From $12 a month - 10
PromptLens
PromptLens is a web platform for teams managing prompts, evaluating changes, and observing production LLM workflows.
Free planWeb6.7From $99 a month - 11

ProofHound
ProofHound automates prompt optimization for LLM classification workflows.
Free planWebAPISelf-hosted6.7From $29 a month - 12
Verdonz
Verdonz is a governed AI platform for investigating business questions across company data, workspace knowledge, and connected systems.
Free planWebAPISelf-hosted6.7From $199 a month - 13
Prompt Manage
Prompt Manage is a platform for teams to store, organize, version, and share AI prompts.
Free planWebAPI6.6From $20 a month - 14
SpacePrompts
SpacePrompts helps people and teams save, organize, test, version, and reuse AI prompts through a web service, browser extensions, and an API.
Free planWebAPIExtension6.6From $5 a month - 15
ChainForge
ChainForge is an open-source visual workspace for designing prompt experiments and assessing large language model responses.
Free planWebSelf-hosted6.4Free plan - 16

HoneyHive
HoneyHive is an agent observability platform for teams that want to observe, evaluate, and improve AI agents in production.
Free planWebAPISelf-hosted6.4Free plan - 17
MLflow GenAI Evaluation
MLflow GenAI Evaluation helps teams assess and monitor LLM applications and AI agents through development and production.
Free planWebAPISelf-hosted6.1Free plan - 18
Prompteams
Prompteams is a prompt management system for developing and version-controlling AI prompts.
Free planWebAPI6.1Free plan - 19
PromptVersions
Free planWeb6.1Free plan - 20
InsightPrompts
InsightPrompts is an enterprise platform for creating, testing, and governing certified AI prompts.
WebAPILinuxmacOS6.0 - 21
PromptOps Manager
PromptOps Manager is a free, self-hosted, open-source registry for versioning, testing, and promoting large-language-model prompts.
Free planWebAPISelf-hosted6.0Free plan - 22

ANTS Platform
ANTS Platform is a web and API service for helping CIOs discover AI tools, agents, and workflows across an organization.
WebAPI5.7From $49 a month - 23
PromptWorks
PromptWorks is a free, Apache-2.0 open-source workspace for teams managing prompts, testing them in batches, and improving them with AI assistance.
WebAPISelf-hosted5.7 - 24
Apastra
Apastra is a file-based PromptOps framework and skill pack for versioning prompts and evaluating agent instructions.
Free planSelf-hosted5.6Free plan
