#1212th of 13 in Observability
Helicone
LLM proxy gateway with request logging, cost tracking and sessions
Live demo ↗
(opens in a new tab)Documentation ↗
(opens in a new tab)Website ↗
(opens in a new tab)Repository on GitHub ↗
(opens in a new tab)
- Stars
- 6.2k
- License
- Apache-2.0
- Last commit
- Sep 2026
- Last release
- Aug 2025
Overview
Sits as an OpenAI-compatible gateway in front of 100+ models with routing and automatic fallbacks, logging every request with cost, latency and session traces, plus a playground and prompt versioning. Self-hosts via a compose script that runs six services: web app, Jawn log server, Workers proxy, Supabase, ClickHouse and MinIO. For engineers who want observability by swapping an endpoint.
Who it is for: Engineers wanting LLM observability by swapping an endpoint
Strengths
- One-line integration: point the OpenAI SDK baseURL at the gateway
- Async logging path via OpenLLMetry for apps that cannot proxy
- Open LLM cost database covering 300+ models; MCP server for data export
- Apache-2.0; self-host compose script included
Weaknesses
- Six-service stack including Supabase, ClickHouse, MinIO and a Cloudflare Workers proxy
- Production Helm chart is enterprise only, by contacting sales
- Manual deployment is explicitly not recommended
- README quickstart is cloud-first; self-hosting details are in external docs
What it needs
- no GPU
- Docker + Compose
- Needs Supabase (database and auth), ClickHouse, MinIO, Cloudflare Workers runtime (proxy)
- Models: 100+ providers via gateway (OpenAI, Azure, Anthropic, Bedrock, Gemini, Groq, Together, Fireworks, Ollama)
Also in Observability
See all 13| Rank | Project | Score |
|---|---|---|
| 1 | LangfuseTracing, prompt management and evals for LLM apps on ClickHouse | 74 out of 100 |
| 2 | PhoenixLLM tracing, evals, datasets and prompt playground built on OpenTelemetry | 74 out of 100 |
| 3 | promptfooCLI for evaluating and red-teaming prompts, agents and RAG | 71 out of 100 |
| #4 | MLflowTracing, evals, prompt registry and AI gateway plus classic ML tracking | 70 out of 100 |
| #5 | OpikTrace, evaluate and monitor LLM apps and agents, Apache-2.0 end to end | 64 out of 100 |