EverythingXiaomi
For vendors
AdvertiseTop spots, featured rows, home sponsor Get listedAdd a product we don't cover yet Claim a listingFree: verify the domain, then correct your page Vendor dashboardNumbers, orders and placements
List your app
Vendor dashboard

Best LM Evaluation Harness Alternatives in 2026

Updated

20 apps from AI LLM evaluation tools ranked against LM Evaluation Harness on the same published basis.

  1. 1
    Vellum Free plan AndroidextensioniOSMacself-hosted $30/mo7.4
    LM Evaluation Harness vs Vellum
  2. 2
    Weights & Biases Free plan apiiOSLinuxMacself-hosted $60/mo7.4
    LM Evaluation Harness vs Weights & Biases
  3. 3
    Evidently AI Free plan apiLinuxMacself-hostedWeb $80/mo7.3
    LM Evaluation Harness vs Evidently AI
  4. 4
    Promptfoo Free plan apiLinuxMacself-hostedWeb Free7.2
    LM Evaluation Harness vs Promptfoo
  5. 5
    DeepEval Free plan LinuxMacself-hostedWin Free7.1
    LM Evaluation Harness vs DeepEval
  6. 6
    Giskard Free plan apiLinuxself-hostedWeb Free7.0
    LM Evaluation Harness vs Giskard
  7. 7
    Opik Free plan apiLinuxself-hostedWeb $19/mo7.0
    LM Evaluation Harness vs Opik
  8. 8
    Rhesis AI Free plan apiLinuxself-hostedWeb Free7.0
    LM Evaluation Harness vs Rhesis AI
  9. 9
    Confident AI Free plan apiself-hostedWeb $200/mo6.9
    LM Evaluation Harness vs Confident AI
  10. 10
    Galileo Free plan apiself-hostedWeb $100/mo6.9
    LM Evaluation Harness vs Galileo
  11. 11
    Langfuse Free plan apiself-hostedWeb $29/mo6.9
    LM Evaluation Harness vs Langfuse
  12. 12
    LangWatch Free plan apiLinuxself-hostedWeb €29/mo6.9
    LM Evaluation Harness vs LangWatch
  13. 13
    Maxim AI Free plan apiself-hostedWeb $29/mo6.9
    LM Evaluation Harness vs Maxim AI
  14. 14
    Braintrust Free plan apiself-hostedWeb $249/mo6.8
    LM Evaluation Harness vs Braintrust
  15. 15
    HoneyHive Free plan apiself-hostedWeb Free6.8
    LM Evaluation Harness vs HoneyHive
  16. 16
    LangSmith Free plan apiself-hostedWeb $39/mo6.8
    LM Evaluation Harness vs LangSmith
  17. 17
    NVIDIA NeMo Evaluator Free plan apiLinuxself-hosted Free6.8
    LM Evaluation Harness vs NVIDIA NeMo Evaluator
  18. 18
    Arize Phoenix Free plan apiself-hostedWeb Free6.7
    LM Evaluation Harness vs Arize Phoenix
  19. 20
    RAGChecker Free plan self-hosted Free6.6
    LM Evaluation Harness vs RAGChecker
  20. 21
    Inspect AI Free plan apiextension Free6.5
    LM Evaluation Harness vs Inspect AI

LM Evaluation Harness alternatives compared

#AppScoreFree planFromRuns on
1Vellum7.4Free plan$30/moAndroid, Browser, iOS, Mac, self-hosted, Web, Windows
2Weights & Biases7.4Free plan$60/moAPI, iOS, Linux, Mac, self-hosted, Web, Windows
3Evidently AI7.3Free plan$80/moAPI, Linux, Mac, self-hosted, Web, Windows
4Promptfoo7.2Free planFreeAPI, Linux, Mac, self-hosted, Web, Windows
5DeepEval7.1Free planFreeLinux, Mac, self-hosted, Windows
6Giskard7.0Free planFreeAPI, Linux, self-hosted, Web
7Opik7.0Free plan$19/moAPI, Linux, self-hosted, Web
8Rhesis AI7.0Free planFreeAPI, Linux, self-hosted, Web
9Confident AI6.9Free plan$200/moAPI, self-hosted, Web
10Galileo6.9Free plan$100/moAPI, self-hosted, Web
11Langfuse6.9Free plan$29/moAPI, self-hosted, Web
12LangWatch6.9Free plan€29/moAPI, Linux, self-hosted, Web
13Maxim AI6.9Free plan$29/moAPI, self-hosted, Web
14Braintrust6.8Free plan$249/moAPI, self-hosted, Web
15HoneyHive6.8Free planFreeAPI, self-hosted, Web
16LangSmith6.8Free plan$39/moAPI, self-hosted, Web
17NVIDIA NeMo Evaluator6.8Free planFreeAPI, Linux, self-hosted
18Arize Phoenix6.7Free planFreeAPI, self-hosted, Web
20RAGChecker6.6Free planFreeself-hosted
21Inspect AI6.5Free planFreeAPI, Browser
Make your app an alternative to LM Evaluation Harness

The sponsored alternative slot on this page is labelled Sponsored.

See the price

Questions about LM Evaluation Harness alternatives

What is the best alternative to LM Evaluation Harness?

Vellum, number 1 in AI LLM evaluation tools with a score of 7.4 out of 10. The others here: Weights & Biases, Evidently AI, Promptfoo and 16 more.

What is the best free alternative to LM Evaluation Harness?

Vellum is the best-ranked alternative with a free plan. 20 of the 20 alternatives here publish a free plan on their own pricing pages.

How are these alternatives ranked?

Ranked on what each maker publishes: documentation depth, a free tier and the platforms it runs on.