Portkey

B tier on AI LLM Observability ToolsScore 7.0 · #5 of 23

Android app: Not listed
Free plan: Yes
Paid plans from: $49/mo
Runs on: api, self-hosted, Web

portkey.ai

Summary

Portkey is a platform for managing, observing, and governing generative AI across teams. Its AI gateway provides a unified API to reach models and providers across modalities, with configurable routing, failovers, retries, and load balancing. For activity monitoring, Portkey offers logs, traces, feedback, metadata, filters, and alerts. Prompt management includes templates, a playground, API endpoints, versioning, and variables. Listed integrations include OpenAI, Anthropic, Google Gemini, Azure, Amazon Bedrock, and Ollama, as well as agent frameworks such as CrewAI, LangChain, LangGraph, and the OpenAI Agents SDK. The gateway also offers simple and semantic caching for repeat requests. Security features include virtual provider keys, access controls, inbound IP and geographic rules, and sensitive-data redaction. Portkey lists self-hosted and local deployment options; Enterprise adds private cloud and VPC hosting. Its free Developer plan includes 10k recorded logs per month and three days of log retention. Production costs $49/month and lists 100k recorded logs monthly, while Enterprise has custom pricing. Portkey lists its headquarters in San Francisco and its launch in March 2023.

Who it is for

Portkey suits teams managing generative AI applications across models or providers that need routing, observability, prompt management, or governance controls. It also offers self-hosted and local deployment options.

What is good

Unified API for models and providers across modalities.
Routing includes failovers, retries, and load balancing.
Prompt tools include versioning and variables.
Self-hosted and local deployment options are listed.
Free plan includes 10k recorded logs monthly.

What to know first

Free-plan log retention is three days.
Production costs $49/month.
Enterprise pricing is custom and not listed.

Verdict

Portkey combines model access, routing, activity monitoring, prompt tools, and governance features for generative AI. Its free plan has short log retention, while longer-term or private deployment options depend on paid plans.

Portkey plans and pricing

All plans

Developer Free Free Forever · 10k recorded logs/month · 3 days log retention · 30 days metrics retention · 3 prompt templates · community support portkey.ai · 29 Sept 2026

Production $49/mo $49/month 100k recorded logs/month · +$9 overages per additional 100k requests · 30 days log retention · 90 days metrics retention · production support portkey.ai · 29 Sept 2026

Enterprise Not published Custom Pricing 10 Mn Plus recorded logs/month · custom retention · private cloud deployment · VPC hosting · priority support portkey.ai · 29 Sept 2026

Compared on AI LLM observability tools

Free plan: Yesportkey.ai
Paid from: $49/moportkey.ai
LLM trace capture: Yesportkey.ai
Token cost tracking: Yesportkey.ai
Output evaluations: Yesportkey.ai
Latency metrics: Yesportkey.ai
Failure tracking: Yesportkey.ai
Free-plan retention: 3 daysportkey.ai

Facts

Product: Portkey describes itself as a production platform for managing, observing, and governing GenAI across teams.portkey.ai · 29 Sept 2026
Gateway: Its AI gateway provides a unified API to access models and providers across modalities.portkey.ai · 29 Sept 2026
Routing: The gateway supports configurable routing, failovers, retries, and load balancing across models.portkey.ai · 29 Sept 2026
Observability: Portkey offers logs, traces, feedback, metadata, filters, and alerts for AI activity.portkey.ai · 29 Sept 2026
Prompt management: Prompt management includes templates, a playground, API endpoints, versioning, and variables.portkey.ai · 29 Sept 2026
Integrations: The integrations catalog lists providers and platforms including OpenAI, Anthropic, Google Gemini, Azure, Amazon Bedrock, and Ollama.portkey.ai · 29 Sept 2026
Agent ecosystem: Documented integrations include agent frameworks such as CrewAI, LangChain, LangGraph, and the OpenAI Agents SDK.portkey.ai · 29 Sept 2026
Caching: Portkey says its gateway offers simple and semantic caching to reduce latency and save costs on repeat requests.portkey.ai · 29 Sept 2026
Guardrails: The Production plan includes LLM and partner guardrails, while Enterprise lists custom guardrail hooks and advanced evaluation templates.portkey.ai · 29 Sept 2026
Security: Security features include virtual provider keys, access controls, inbound IP and geographic rules, and sensitive-data redaction.portkey.ai · 29 Sept 2026
Compliance: The Enterprise plan lists SOC 2 Type 2, GDPR, and HIPAA under advanced compliance, along with custom BAAs and data isolation.portkey.ai · 29 Sept 2026
Deployment: Portkey lists self-hosted and local deployment options, and Enterprise offers private cloud deployment and VPC hosting.portkey.ai · 29 Sept 2026
Support: The Free plan lists community support, Production lists production support, and Enterprise lists dedicated onboarding and priority support.portkey.ai · 29 Sept 2026
Company: Portkey’s company information page lists San Francisco, California as its headquarters and March 2023 as its launch date.portkey.ai · 29 Sept 2026