#1111th of 14 in Gateways
Portkey Gateway
Node.js LLM gateway with fallbacks, load balancing and guardrails
- Stars
- 13.2k
- License
- MIT
- Last commit
- May 2026
- Last release
- Jan 2026
Overview
Portkey Gateway is a Node.js proxy that routes requests to 250+ LLM providers through an OpenAI-style API on port 8787, runnable with npx, Docker or Cloudflare Workers. Config objects add retries, fallbacks, load balancing, conditional routing, timeouts and 40+ guardrails; a console at /public shows local logs. Semantic caching, prompt management and RBAC are hosted or enterprise features.
Who it is for: teams needing resilient multi-provider routing with guardrails
Strengths
- Runs with npx in Node.js; 122 KB footprint, sub-millisecond overhead claimed
- Fallbacks, retries, load balancing, conditional routing and timeouts via config
- 40+ built-in guardrails plus bring-your-own
- Works with OpenAI, LangChain, LlamaIndex, CrewAI and Autogen SDKs
Weaknesses
- Semantic caching, prompt management and provider optimization are hosted or enterprise only
- Last commit 2026-05-25; Gateway 2.0 enterprise merge still pre-release
- Docs links are portkey.wiki short links
- RBAC, PII redaction and compliance features are enterprise
What it needs
- no GPU
- Docker + Compose
- Models: OpenAI, Azure OpenAI, Anthropic, Gemini, Cohere, Mistral, Together, Perplexity, Ollama, Bedrock, Groq and 45+ providers
- port 8787
Also in Gateways
See all 14| Rank | Project | Score |
|---|---|---|
| 1 | OmniRouteOpenAI-compatible gateway that routes requests across hundreds of AI providers | 86 out of 100 |
| 2 | LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers | 84 out of 100 |
| 3 | freellmapiOpenAI-compatible router that fails over across free LLM provider tiers | 76 out of 100 |
| #4 | ContextForge MCP GatewayRegistry and proxy federating MCP, A2A, REST and gRPC behind one endpoint | 68 out of 100 |
| #5 | HigressEnvoy-based API gateway with LLM proxy plugins and MCP server hosting | 61 out of 100 |