Gateways & routers
Portkey
AI gateway with routing, caching, retries, and guardrails, plus request-level observability.
- Category
- Gateways & routers
- Pricing
- Free tier
- Runs
- Hosted or self-hosted
- Interface
- API, Dashboard
- Source
- Open source
What Portkey is
Portkey combines a gateway with an observability layer, so routing and tracing are configured in the same place rather than bolted together. It adds conditional routing, semantic caching, automatic retries, and guardrails on request and response. The core gateway is open source and can be self-hosted.
Best for
Teams that want routing and request-level tracing from one system instead of integrating a gateway and an observability tool separately.
Consider something else if
The combined surface is broader than a plain proxy; if you only need failover, something narrower is less to learn.
Portkey alternatives
The closest options in gateways & routers, on the axes that actually separate them.
| Tool | Best for | Pricing | Runs |
|---|---|---|---|
| Portkeyopen source | Teams that want routing and request-level tracing from one system instead of integrating a gateway and an observability tool separately. | Free tier | Hosted or self-hosted |
| OpenRouter | Trying many models quickly, or shipping something that must keep working when a single provider degrades. | Usage-based | Hosted |
| LiteLLMopen source | Teams that want gateway behaviour — budgets, key management, failover — without adding a third-party service to the request path. | Open source | Hosted or self-hosted |
| Heliconeopen source | Getting cost and latency visibility across a codebase quickly, especially one you do not want to instrument. | Free tier | Hosted or self-hosted |
| Cloudflare AI Gateway | Adding caching and cost visibility to calls you already make, especially if you are on Cloudflare already. | Free tier | Hosted |
Choosing within gateways & routers
Hosted or self-hosted
A hosted gateway is another service in your critical path — when it is down, you are down. A self-hosted proxy keeps the failure domain yours but is now yours to run. Some options offer both; pick before you build around one.
What it costs you in latency
Every gateway adds a network hop. That is usually single-digit milliseconds and irrelevant next to generation time, but it matters for high-volume classification where the model call itself is short.
Questions
What is Portkey?
Portkey combines a gateway with an observability layer, so routing and tracing are configured in the same place rather than bolted together. It adds conditional routing, semantic caching, automatic retries, and guardrails on request and response. The core gateway is open source and can be self-hosted. It is open source and hosted or self-hosted.
What are the alternatives to Portkey?
The closest alternatives are OpenRouter, LiteLLM, Helicone, Cloudflare AI Gateway. They sit in the same category — gateways & routers — and differ mainly on hosting model, pricing shape, and how much they abstract away.
Is Portkey the right choice?
Teams that want routing and request-level tracing from one system instead of integrating a gateway and an observability tool separately. The main caveat: The combined surface is broader than a plain proxy; if you only need failover, something narrower is less to learn.
Whatever you build on, the model is the line item that scales. See what each one costs per million tokens, or price your own workload.