33rd of 12 in RAG and search

llm-app

Pathway RAG pipeline templates that re-index live data sources

Stars
58.8k
License
MIT
Last commit
Jul 2026
Language
Jupyter Notebook

Overview

Eight Dockerized Python pipelines on the Pathway framework: question-answering RAG, a live document indexer, multimodal RAG with GPT-4o, unstructured-to-SQL, adaptive RAG, a private Mistral plus Ollama variant, slide search and video RAG. Each watches a source (file system, Google Drive, SharePoint, S3, Kafka, Postgres), keeps an in-memory vector and full-text index current and serves an HTTP API. For teams whose documents change constantly.

Who it is for: Teams running RAG over documents that change constantly

Strengths

  • No separate vector DB, cache or API framework; indexing is in-process (usearch, Tantivy)
  • Connectors for file system, Google Drive, SharePoint, S3, Kafka and Postgres with live sync
  • Private variant runs fully local with Mistral and Ollama
  • Docker images and tests included

Weaknesses

  • Pathway is the real dependency; its Rust engine is opaque to most Python teams
  • Pipelines are backends; the UI is an optional Streamlit demo
  • Root README has no setup; each template README is required reading
  • Index lives in memory; sizing for millions of pages is on you

What it needs

  • Jupyter Notebook, pathway, openai, mistral, ollama
  • Needs docker, openai-api-key, data-source-credentials

Also in RAG and search

See all 12
Also in RAG and search
RankProjectScore
1azure-search-openai-demoAzure RAG chat reference on AI Search and Azure OpenAI7.8k stars, MIT56 out of 100
2rag-postgres-openai-pythonRAG over Postgres table rows with hybrid search and SQL filters505 stars, MIT51 out of 100
#4chat-langchainLangChain docs assistant as a Managed Deep Agent with Next.js UI6.5k stars, MIT45 out of 100
#5chat-with-your-data-solution-acceleratorAzure RAG chat app that answers from your documents with citations1.2k stars, MIT44 out of 100
#6llm-answer-enginePerplexity-style Next.js answer engine over Brave search results5k stars, MIT41 out of 100