# What self-hosted RAG and LLM app platforms are available?

Canonical page: https://launchinyourcloud.com/questions/rag-llm-platforms/

Examples include [RAGFlow](/directory/ragflow/) and [Dify](/directory/dify/) for AI applications, [Qdrant](/directory/qdrant/) and [Weaviate](/directory/weaviate/) for vector storage, and [Langfuse](/directory/langfuse/) for observability. They occupy different layers; this is not a verified combined stack. Check model endpoints and connector data flows.

Answer page: https://launchinyourcloud.com/questions/rag-llm-platforms/
Answer reviewed: 2026-11-21

- [AI applications and RAG](/categories/ai-applications-rag/)
- [AI observability and LLMOps](/categories/ai-observability/)


## Choose the layer you need

- Separate application workflow and ingestion from vector storage, embeddings, inference, tracing and evaluation.
- Test representative documents, retrieval quality, connector credentials, deletion and access control across the full data path.
- Review model APIs, trace payloads, edition licensing and resource requirements independently for each selected component.

## Avoid treating examples as a tested stack

The listings below illustrate several layers of an AI system. Their individual deployment paths do not certify interoperability or a common-provider deployment. Follow the integration documentation for the exact versions and measure your own ingestion, query and evaluation workloads.

## Reviewed listing references

These are illustrative candidates, not a ranking or a feature-parity claim.

### Dify Self-Hosted

Visual AI application and RAG workflow platform available as a self-hosted container stack.

Operations: Customer operates the containers, persistent stores, secrets, backups and upgrades; commercial edition support varies.
License: Modified Apache 2.0 terms; multi-workspace service operation and frontend branding can require commercial authorization.
Scope: Self-hosting Dify does not itself host every model used by a flow. Model-provider plugins, embedding services, tools and connectors may send inputs or retrieved content outside the deployment. Select local endpoints where required and review each dependency. This entry does not conflate the generic self-hosted stack with the separately licensed AWS Premium edition. Dify 1.20.0 changes deployment and API behavior: OPENAPI_ENABLED defaults to true, shared.env is retired, six migrations apply from 1.19, and HITL, plugin-daemon, OpenShell, and optional file-scanning requirements change. It also fixes OAuth callback reuse, member-role enforcement, vector deletion scope, public stream detail exposure, and CVE-2026-116591.
Listing and sources: https://launchinyourcloud.com/directory/dify/
Reviewed: 2026-11-18

### Langfuse Self-Hosted

Self-hosted LLM observability, evaluations and prompt-management platform.

Operations: Customer operates the deployment, persistence, access policies, retention, backups and scaling.
License: MIT core; designated enterprise directories and add-on capabilities use separate license terms or keys.
Scope: Traces can contain prompts, outputs and other sensitive application data, so configure capture and retention deliberately. Self-hosted trace storage does not move the underlying application model into the same account. Optional model-based evaluators or the gateway use configured providers, which may be external. The single-VM Compose example does not provide production high availability or backups. Langfuse v4.82.0 fixes an SSRF path in GitHub Enterprise SSO and moves audit logs to ClickHouse. Review outbound SSO connectivity and audit-log storage during upgrade.
Listing and sources: https://launchinyourcloud.com/directory/langfuse/
Reviewed: 2026-11-18

### Qdrant Self-Hosted

Self-hosted vector database for semantic retrieval and AI application data.

Operations: Customer manages persistence, backups, access controls, upgrades and any distributed-cluster operations.
License: Apache 2.0 for the upstream database; managed cloud offerings and support have separate commercial terms.
Scope: The local quickstart is an installation starting point, not a secured production configuration. Applications can supply their own vectors or use separately configured embedding models. External embedding APIs and hosted inference can receive source data even when the database is self-hosted; local FastEmbed is a documented alternative. This entry excludes Qdrant Cloud hosting. Qdrant 1.20.1, released November 13, 2026, prevents collection-scoped JWTs from viewing snapshot telemetry for collections they cannot access; operators using scoped JWTs should upgrade.
Listing and sources: https://launchinyourcloud.com/directory/qdrant/
Reviewed: 2026-11-14

### RAGFlow

Document processing and retrieval platform for building RAG and agentic knowledge applications.

Operations: Customer manages document storage, indexing, app services, access controls, model endpoints, backups and upgrades.
License: Apache License 2.0 for upstream RAGFlow; models, data assets and dependencies retain their own terms.
Scope: Deployment options include customer AWS, Azure and Google Cloud infrastructure, Alibaba Compute Nest, and a Railway project. The evidence trail identifies the publishers and template versions. Hosting RAGFlow does not automatically self-host its LLM, embeddings or reranker; choose private or local model endpoints where required.
Listing and sources: https://launchinyourcloud.com/directory/ragflow/
Reviewed: 2026-11-12

### Weaviate Self-Hosted

Self-hosted vector-search database for retrieval and AI applications.

Operations: Customer manages authentication, storage, backup, scaling, configuration and upgrades.
License: BSD-3-Clause core outside the wl directory; wl code and associated enterprise features require a separate enterprise license/key.
Scope: The Docker defaults include anonymous access and default telemetry; production installations must configure the intended controls. Pre-vectorized data can be searched without an external vectorizer, but enabled embedding, reranking or generation integrations may call external providers. Telemetry is enabled by default and has a documented opt-out; the entire current codebase must not be described as uniformly BSD-licensed. Weaviate v1.39.17 fixes a v1.39 runtime-reindex restart bug in which writes arriving before reindex resumed could be absent from the new property index, or an incomplete index could be swapped in after partial files disappeared. Operators remaining on v1.39 should update and verify filter/search results; the primary reviewed release remains the newer v1.40.5 line.
Listing and sources: https://launchinyourcloud.com/directory/weaviate/
Reviewed: 2026-11-21

