#77th of 14 in Gateways

Plano

Envoy-based data plane that routes, traces and guards agent traffic

Stars
7.1k
License
Apache-2.0
Last commit
Oct 2026
Last release
Sep 2026

Overview

Plano is an Envoy-based proxy for agentic apps: a YAML file declares agents (HTTP servers with an OpenAI chat endpoint), model providers and listeners, and Plano routes each turn to the right agent with its 4B orchestrator model (hosted free or run locally). It also routes LLM calls by model name, alias or preference, captures OpenTelemetry traces with no instrumentation and applies guardrails via filter chains.

Who it is for: teams shipping multi-agent apps that need routing and tracing

Strengths

  • Declarative multi-agent orchestration; agents are plain OpenAI-compatible HTTP servers
  • Zero-code OpenTelemetry traces and agentic signals for every request
  • Filter chains add moderation, jailbreak checks and memory out of process
  • Model routing by name, alias or preference across providers

Weaknesses

  • Agent routing depends on Plano's own orchestrator model; hosted by default
  • Install prerequisites live in external docs; README shows only YAML and curl
  • Envoy underneath; heavier than a single-binary proxy
  • No port or resource guidance beyond example listeners

What it needs

  • no GPU
  • Docker
  • Needs Plano-Orchestrator routing model (hosted or local)
  • Models: OpenAI, Anthropic and other providers configured as model_providers

Also in Gateways

See all 14
Also in Gateways
RankProjectScore
1OmniRouteOpenAI-compatible gateway that routes requests across hundreds of AI providers75k stars, MIT86 out of 100
2LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers60.9k stars, custom license84 out of 100
3freellmapiOpenAI-compatible router that fails over across free LLM provider tiers32.9k stars, MIT76 out of 100
#4ContextForge MCP GatewayRegistry and proxy federating MCP, A2A, REST and gRPC behind one endpoint4.6k stars, Apache-2.068 out of 100
#5HigressEnvoy-based API gateway with LLM proxy plugins and MCP server hosting Live demo ↗ (opens in a new tab)9.5k stars, Apache-2.061 out of 100