#88th of 13 in Observability

LangWatch

Agent observability, simulation testing, AI gateway and governance in one

Stars
4.9k
License
Apache-2.0
Last commit
Oct 2026
Last release
Oct 2026

Overview

Traces LLM and agent calls through OpenTelemetry and SDK integrations, runs simulation-based agent tests and evaluations, manages prompts, and adds an OpenAI- and Anthropic-compatible gateway with virtual keys and budgets. Also tracks coding-agent sessions (Claude Code, Codex, Copilot) with cost per pull request, and starts locally with npx @langwatch/server. For platform teams governing AI use across a company.

Who it is for: Platform teams governing AI usage across a company

Strengths

  • npx @langwatch/server starts a local instance with only Node.js installed
  • Coding-agent tracking: sessions and cost per PR for Claude Code, Codex, Copilot
  • Gateway virtual keys with budgets for customers or employees
  • Governance ingests Copilot Studio, Claude and OpenAI compliance APIs, Workato, S3 audit feeds

Weaknesses

  • Open-core: modules under platform/app/ee need a commercial license in production
  • No Dockerfile or compose file at the repo root; production setup is in external docs
  • README is a feature index; architecture and storage needs are not described
  • Cloud signup is the first call to action; self-host gets one line

What it needs

  • no GPU
  • Needs Node.js
  • Models: OpenAI, Anthropic, Azure OpenAI, Vertex AI, Bedrock

Also in Observability

See all 13
Also in Observability
RankProjectScore
1LangfuseTracing, prompt management and evals for LLM apps on ClickHouse Live demo ↗ (opens in a new tab)35.6k stars, custom license74 out of 100
2PhoenixLLM tracing, evals, datasets and prompt playground built on OpenTelemetry11.8k stars, custom license74 out of 100
3promptfooCLI for evaluating and red-teaming prompts, agents and RAG25.9k stars, MIT71 out of 100
#4MLflowTracing, evals, prompt registry and AI gateway plus classic ML tracking Live demo ↗ (opens in a new tab)28.3k stars, Apache-2.070 out of 100
#5OpikTrace, evaluate and monitor LLM apps and agents, Apache-2.0 end to end22.5k stars, Apache-2.064 out of 100