What self-hosted RAG and LLM app platforms are available?
Read this page as JSON or Markdown.
Choose the layer you need
- Separate application workflow and ingestion from vector storage, embeddings, inference, tracing and evaluation.
- Test representative documents, retrieval quality, connector credentials, deletion and access control across the full data path.
- Review model APIs, trace payloads, edition licensing and resource requirements independently for each selected component.
Avoid treating examples as a tested stack
The listings below illustrate several layers of an AI system. Their individual deployment paths do not certify interoperability or a common-provider deployment. Follow the integration documentation for the exact versions and measure your own ingestion, query and evaluation workloads.
Explore the reviewed listings
Illustrative candidates, shown alphabetically. Read each listing’s sources, edition limits and operating responsibilities; this is not a ranking or a feature-parity claim.
Dify Self-Hosted
Visual AI application and RAG workflow platform available as a self-hosted container stack.
Customer-operated · Source Available · Reviewed 2026-11-18. Read deployment evidence →
Langfuse Self-Hosted
Self-hosted LLM observability, evaluations and prompt-management platform.
Customer-operated · Open Source / Open Core · Reviewed 2026-11-18. Read deployment evidence →
Qdrant Self-Hosted
Self-hosted vector database for semantic retrieval and AI application data.
Customer-operated · Open Source / Open Core · Reviewed 2026-11-14. Read deployment evidence →
RAGFlow
Document processing and retrieval platform for building RAG and agentic knowledge applications.
Customer-operated · Open Source / Open Core · Reviewed 2026-11-12. Read deployment evidence →
Weaviate Self-Hosted
Self-hosted vector-search database for retrieval and AI applications.
Customer-operated · Open Source / Open Core · Reviewed 2026-11-21. Read deployment evidence →
Sources and further guidance
Answer reviewed 2026-11-21. Check the exact edition, configuration and current vendor terms before deciding.