18.7
Vellum describes itself as a personal AI assistant that can read files, manage calendars, send email, run code, and control a computer.
Free planOpen sourceAndroidiOSWeb
Alternatives to OpenAI Playground
28.3
DeepEval is a free, open-source framework for creating evaluation pipelines that test AI systems.
Free planOpen sourceWebAPILinux
38.2
Langfuse is an open-source AI engineering platform for teams debugging, analyzing, and iterating on AI agent applications.
Free planOpen sourceWebAPILinux
- 4
Agenta
Agenta is an open-source workspace for teams to build, use, and automate AI coworkers.
Free planOpen sourceWebAPISelf-hosted8.0From $29 a month - 5
LangSmith
LangSmith is a platform for building, evaluating, deploying, monitoring, and improving AI agents.
Free planWebAPILinuxmacOS8.0$39 usage-based - 6
Promptfoo
Promptfoo helps developers and enterprises evaluate prompts and test AI applications for security risks.
Free planOpen sourceWebAPILinuxmacOS7.8Free plan - 7
Braintrust
Braintrust is an observability platform for teams improving AI agents that run in production.
Free planWebAPISelf-hosted7.7From $249 a month - 8
W&B Weave
W&B Weave provides observability and continuous improvement tools for production AI agents.
Free planWebAPILinuxmacOS7.3$60 usage-based - 9
TruLens
TruLens is a free, open-source Python SDK for tracing and evaluating AI agents, RAG applications, MCP apps, and summarization systems.
Free planOpen sourceAPISelf-hosted7.2Free plan - 10
Maxim AI
Maxim AI is an evaluation and observability platform for simulating, assessing, and monitoring AI agents.
Free planWebAPISelf-hosted7.0From $29 a month - 11
PromptLayer
PromptLayer is a platform for teams that build and improve AI products.
Free planWebAPISelf-hosted7.0From $49 a month - 12
Galileo
Galileo is an observability, evaluation, and guardrail platform for generative AI and agentic applications.
Free planWebAPISelf-hosted6.9From $100 a month - 13
Laminar
Laminar is an open-source observability and debugging platform for AI agents, designed around OpenTelemetry.
Free planWebAPISelf-hosted6.8$30 usage-based - 14
ProofHound
ProofHound automates prompt optimization for LLM classification workflows.
Free planWebAPISelf-hosted6.7From $29 a month - 15
Giskard
Giskard is a freemium platform for finding security and quality problems in AI agents before production use.
Free planWebAPILinuxSelf-hosted6.6Free plan - 16
ChainForge
ChainForge is an open-source visual workspace for designing prompt experiments and assessing large language model responses.
Free planWebSelf-hosted6.5Free plan - 17
HoneyHive
HoneyHive is an agent observability platform for teams that want to observe, evaluate, and improve AI agents in production.
Free planWebAPISelf-hosted6.4Free plan - 18
Arize Phoenix
Arize Phoenix helps teams trace, evaluate, debug, and improve AI applications.
Free planWebAPISelf-hosted6.3Free plan - 19
MLflow Model Registry
MLflow Model Registry is a centralized model store, API, and interface for managing machine-learning models throughout their lifecycle.
Free planWebAPILinuxSelf-hosted6.2Free plan - 20
DSPy
DSPy is a free, MIT-licensed, open-source Python framework for building AI programs and systems.
APISelf-hosted5.7 - 21
TextGrad
TextGrad is a free Python package for building pipelines that optimize text and other targets with language-model feedback.
LinuxSelf-hosted5.5 - 22
4.8 - 234.8
- 244.3