Langfuse vs OpenCompass

Langfuse

6.9 #7 in AI Agent Observability Tools

About Langfuse

OpenCompass

6.5 #24 in AI LLM Evaluation Tools

About OpenCompass
LangfuseOpenCompass
Free planYes
Paid from$29/mo
Platformsapi, self-hosted, Webapi, Linux, self-hosted, Windows
Free planYes
Paid from29 /mo
Cost trackingYes
Token cost trackingYes
LLM tracingYes
LLM evaluationsYes
Prompt managementYes
Agent tracingYes
Retrieval tracingYes
Deployment optionsboth
Evaluation methodsobjective; subjective; discriminative; generative; LLM-as-a-judge
Model supportHugging Face models; API-based models; custom models; OpenAI; Anthropic; Gemini; Qwen; GLM; DeepSeek
Safety evaluationsYes
Deploymentself-hosted

Listed together in Best AI LLM Evaluation Tools