Alternatives to Portkey

18.4

Opik

Opik helps teams building applications or agents that call an LLM log actions and evaluate behavior through development, testing, and production.

Free planOpen sourceWebAPILinux

From $19 a month

VisitDetails

28.3

DeepEval

DeepEval is a free, open-source framework for creating evaluation pipelines that test AI systems.

Free planOpen sourceWebAPILinux

From $200 a month

VisitDetails

38.2

Langfuse

Langfuse is an open-source AI engineering platform for teams debugging, analyzing, and iterating on AI agent applications.

Free planOpen sourceWebAPILinux

From $29 a month

VisitDetails

4. 4

   LangSmith

   LangSmith is a platform for building, evaluating, deploying, monitoring, and improving AI agents.

   Free planWebAPILinuxmacOS
   8.0$39 usage-based
   Visit
5. 5

   Promptfoo

   Promptfoo helps developers and enterprises evaluate prompts and test AI applications for security risks.

   Free planOpen sourceWebAPILinuxmacOS
   7.8Free plan
   Visit
6. 6

   Braintrust

   Braintrust is an observability platform for teams improving AI agents that run in production.

   Free planWebAPISelf-hosted
   7.7From $249 a month
   Visit
7. 7

   LlamaIndex

   LlamaIndex helps developers and enterprises process documents and build AI workflows around them.

   Free planWebAPILinuxSelf-hosted
   7.1From $50 a month
   Visit
8. 8

   PromptLayer

   PromptLayer is a platform for teams that build and improve AI products.

   Free planWebAPISelf-hosted
   7.0From $49 a month
   Visit
9. 9

   Helicone

   Helicone is a platform for routing, debugging, and analyzing AI applications.

   Free planWebAPISelf-hosted
   6.9From $79 a month
   Visit
10. 10

    LangChain

    LangChain is a free, open-source framework for building agents that connect models with tools.

    Free planAPISelf-hosted
    6.8$39 usage-based
    Visit
11. 11CA

    CrewAI AMP

    Free planWebAPISelf-hosted
    6.4Free plan
    Visit
12. 12

    Haystack

    Haystack is an open-source AI orchestration framework for developers building agents, multimodal applications, advanced retrieval-augmented…

    Free planAPISelf-hosted
    6.4Free plan
    Visit
13. 13

    OpenRouter

    OpenRouter provides access to hundreds of AI models through a single API endpoint.

    Free planWebAPI
    6.4Free plan
    Visit
14. 14AP

    Arize Phoenix

    Arize Phoenix helps teams trace, evaluate, debug, and improve AI applications.

    Free planWebAPISelf-hosted
    6.3Free plan
    Visit
15. 15RE

    Replicate

    Free planWebAPI
    6.3Free plan
    Visit
16. 16

    LiteLLM

    Free planWebAPISelf-hosted
    6.2Free plan
    Visit
17. 17

    Hugging Face Inference Endpoints

    WebAPI
    6.0From $0.06 a month
    Visit
18. 18DS

    DSPy

    DSPy is a free, MIT-licensed, open-source Python framework for building AI programs and systems.

    APISelf-hosted
    5.7
    Visit
19. 19

    Fireworks AI

    WebAPISelf-hosted
    5.7
    Visit
20. 20

    Ragas

    Ragas is a free, self-hosted library for systematically evaluating large language model applications.

    APILinuxSelf-hosted
    5.7
    Visit
21. 21CN

    Cohere North

    WebSelf-hosted
    5.5
    Visit
22. 22AU

    AutoGen

    LinuxmacOSWindows
    4.9
    Visit
23. 23GR

    GroqCloud

    Web
    4.8
    Visit
24. 24GG

    Google Gemini API

    Web
    4.7
    Visit
25. 25VA

    Vercel AI SDK
    4.4
    Visit

Back to Portkey