ArchestackGitHub ↗ (opens in a new tab)

22nd of 13 in Chat UIs

AnythingLLM

Document chat and agent app with built-in RAG, MCP and multi-user support

Documentation ↗ (opens in a new tab)Website ↗ (opens in a new tab)Repository on GitHub ↗ (opens in a new tab)
Stars
66.9k
License
MIT
Last commit
Oct 2026
Last release
Oct 2026

Overview

AnythingLLM is a Node.js app that ingests PDF, TXT, DOCX and other files into a workspace and chats over them with any of 40+ LLM providers, from llama.cpp, Ollama and LM Studio to OpenAI, Anthropic, Bedrock and Gemini. It ships a native embedder, LanceDB by default plus 8 other vector stores, a no-code agent builder, MCP support, scheduled tasks, model routing and a developer API.

Who it is for: Small teams and individuals wanting private document chat without extra services

Strengths

  • LanceDB embedded by default; PGVector, Qdrant, Milvus, Chroma, Weaviate, Pinecone optional
  • Native embedder and audio transcription run locally with no extra service
  • Multi-user instance with per-user permissions in the Docker build
  • Embeddable website chat widget and a full developer API

Weaknesses

  • Anonymous telemetry to PostHog is on by default; opt out with DISABLE_TELEMETRY=true
  • Multi-user support and the embed widget are Docker-only, not in the desktop app
  • Speech-to-text is limited to the browser built-in engine
  • No root Dockerfile; container build lives under docker/

What it needs

  • no GPU
  • Docker + Compose
  • Models: llama.cpp-compatible models, OpenAI, Azure OpenAI, AWS Bedrock, Anthropic

Also in Chat UIs

See all 13
Also in Chat UIs
RankProjectScore
1LobeHubAgent workspace with builder, groups, scheduling and 10,000+ MCP skills83.1k stars, custom license80 out of 100
3Open WebUISelf-hosted chat UI for Ollama and OpenAI-compatible APIs with RBAC and RAG154.2k stars, custom license76 out of 100
#4big-AGIMulti-model chat workspace with Beam side-by-side model comparison7.1k stars, MIT71 out of 100
#5Hermes WebUIBrowser UI for Hermes Agent with sessions and file browser18.8k stars, MIT69 out of 100
#6LibreChatMulti-provider ChatGPT-style app with agents, MCP, code interpreter and auth45.5k stars, MIT66 out of 100