AI applications & RAG on AWS
AI application builders, chat interfaces, agents and retrieval-augmented generation.
5 documented options on Amazon Web Services. Provider coverage reflects reviewed evidence, not an exhaustive compatibility claim.
Read this page as JSON or Markdown.
| Listing | Documented clouds | Deployment and infrastructure | Licensing | Installation | Operations and limitations |
|---|---|---|---|---|---|
| AnythingLLM Docker | AWS, Google Cloud, Railway | Customer-operated Servers / containers | Open Source / Open Core MIT License for upstream AnythingLLM; model weights, connectors and provider services have separate terms. | Run the official Docker edition on a customer-operated host with persistent application storage and configured model/vector endpoints. | Customer manages users, documents, persistent storage, model access, integration secrets, backups and upgrades.Scope and evidenceThe Docker edition supports multi-user operation and differs from the desktop application. Local inference is an option; configured external LLMs, embeddings, vector stores and agent tools can send data outside the account. AnythingLLM v1.20.0 hardens embed history, extension API-key authorization, workspace-agent access, password recovery, framing, and document-tool downloads. Optional MCP identity forwarding creates a new outbound identity path; keep the server and extension on compatible 1.20+ versions.
Cloud evidence reviewed 2026-11-12 |
| Langflow Self-Hosted | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Open Source / Open Core MIT for the upstream project; connected models, providers and bundles have their own terms. | Official Docker image or Docker Compose; Python installation and Kubernetes options are also documented. | Customer manages the application, database, access controls, installed components, backups and version upgrades.Scope and evidenceThe reviewed model-component docs support Ollama and configurable OpenAI-compatible endpoints as well as commercial providers. External models, embeddings, tools or custom components can move data beyond the host. Hosting Langflow is distinct from hosting those dependencies and from any vendor-managed service. Langflow 1.13.3 enforces custom-component policy in background workflows, invalidates native sessions after password changes, updates security dependencies, and aligns Docker and wheel packaging. Recheck custom components and session behavior after upgrading.
Cloud evidence reviewed 2026-11-12 |
| Onyx Self-Hosted | AWS, Azure, Google Cloud, DigitalOcean | Customer-operated Servers / containers | Open Source / Open Core MIT Community Edition; Business and Enterprise features use separate commercial terms. | Docker Compose on a VM or official Kubernetes and Terraform deployment | Customer manages application services, databases, search, object storage, connectors, model credentials, backups, scaling and upgrades.Scope and evidenceThis entry covers self-hosted Onyx, not a vendor-hosted environment. External LLM, embedding and connector services receive data according to the customer's configuration. Business and Enterprise features and support require separate commercial entitlements.
Cloud evidence reviewed 2026-11-14 |
| Open WebUI Self-Hosted | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Source Available Open WebUI license based on BSD-style terms with additional branding restrictions and defined exceptions; enterprise terms may be required for rebranding. | Official Docker image, Python installation or Kubernetes deployment. | Customer runs application storage, authentication, provider configuration, updates and backups.Scope and evidenceThe UI sends messages to the model endpoint selected for a conversation. Local Ollama or vLLM endpoints can keep inference on customer infrastructure; cloud APIs, embeddings, tools and plugins have separate data flows. The current license restricts branding removal in larger deployments, with small-deployment, permission and enterprise-license exceptions; review the actual terms. Open WebUI v0.13.4 replaces Direct Connections and Integrations with Tether and migrates image settings. Deployments using Terminals server connections require Terminals 0.4.0 or later; upgrading that server from 0.3.x requires manual migration. Open Terminal and Tether terminal connections are unaffected by this migration. Tether introduces user-device and local-command paths that require explicit trust review.
Cloud evidence reviewed 2026-11-12 |
| RAGFlow | AWS, Azure, Google Cloud, Alibaba Cloud, Railway | Customer-operated Servers / containers | Open Source / Open Core Apache License 2.0 for upstream RAGFlow; models, data assets and dependencies retain their own terms. | Versioned upstream Docker Compose, provider-specific VM packages or community deployment templates; select a path compatible with the intended RAGFlow release. | Customer manages document storage, indexing, app services, access controls, model endpoints, backups and upgrades.Scope and evidenceDeployment options include customer AWS, Azure and Google Cloud infrastructure, Alibaba Compute Nest, and a Railway project. The evidence trail identifies the publishers and template versions. Hosting RAGFlow does not automatically self-host its LLM, embeddings or reranker; choose private or local model endpoints where required.
Cloud evidence reviewed 2026-11-12 |
Deployment evidence and category fit
AnythingLLM Docker
Multi-user application for document-grounded chat, RAG and agents with configurable model and vector-database integrations.
The Docker edition supports multi-user operation and differs from the desktop application. Local inference is an option; configured external LLMs, embeddings, vector stores and agent tools can send data outside the account. AnythingLLM v1.20.0 hardens embed history, extension API-key authorization, workspace-agent access, password recovery, framing, and document-tool downloads. Optional MCP identity forwarding creates a new outbound identity path; keep the server and extension on compatible 1.20+ versions.
- AnythingLLM Docker installation overview ↗
Vendor / upstream documentation · Reviewed 2026-11-12. Vendor support commitment: not assessed; confirm the selected release and contract.
The project explicitly names AWS, Google Cloud and Railway for self-hosting the Docker edition, paired with its Docker installation workflow. This is an upstream hosting compatibility statement. Model endpoints, embeddings and external vector stores are separately configured and can have different data boundaries.
Cloud evidence reviewed 2026-11-12. Full listing and qualifications
Langflow Self-Hosted
Visual builder and runtime for AI flows, agents and model integrations. Local model endpoints are configurable; a flow can also call externally hosted providers.
The reviewed model-component docs support Ollama and configurable OpenAI-compatible endpoints as well as commercial providers. External models, embeddings, tools or custom components can move data beyond the host. Hosting Langflow is distinct from hosting those dependencies and from any vendor-managed service. Langflow 1.13.3 enforces custom-component policy in background workflows, invalidates native sessions after password changes, updates security dependencies, and aligns Docker and wheel packaging. Recheck custom components and session behavior after upgrading.
- Langflow Kubernetes deployment architecture ↗
Vendor / upstream documentation · Reviewed 2026-11-12. Vendor support commitment: not assessed; confirm the selected release and contract.
The project explicitly identifies EKS, AKS and GKE for its Helm deployment. Separate the development IDE from the production runtime, and review PostgreSQL, model endpoints and external vector stores.
Cloud evidence reviewed 2026-11-12. Full listing and qualifications
Onyx Self-Hosted
Provides enterprise search, connectors and retrieval-augmented AI assistants over customer-selected knowledge sources.
This entry covers self-hosted Onyx, not a vendor-hosted environment. External LLM, embedding and connector services receive data according to the customer's configuration. Business and Enterprise features and support require separate commercial entitlements.
- Onyx on AWS ↗
Vendor / upstream documentation · Reviewed 2026-11-14. Vendor support commitment: not assessed; confirm the selected release and contract.
Onyx documents self-hosting on a customer EC2 instance and links a production EKS architecture using AWS managed dependencies.
Cloud evidence reviewed 2026-11-14. Full listing and qualifications
Open WebUI Self-Hosted
Deployable team chat and model-access interface with retrieval features. It is an interface and application layer, not an included license or runtime for every connected model.
The UI sends messages to the model endpoint selected for a conversation. Local Ollama or vLLM endpoints can keep inference on customer infrastructure; cloud APIs, embeddings, tools and plugins have separate data flows. The current license restricts branding removal in larger deployments, with small-deployment, permission and enterprise-license exceptions; review the actual terms. Open WebUI v0.13.4 replaces Direct Connections and Integrations with Tether and migrates image settings. Deployments using Terminals server connections require Terminals 0.4.0 or later; upgrading that server from 0.3.x requires manual migration. Open Terminal and Tether terminal connections are unaffected by this migration. Tether introduces user-device and local-command paths that require explicit trust review.
- Open WebUI deployment on AWS ECS / Fargate ↗
Vendor / upstream documentation · Reviewed 2026-11-12. Vendor support commitment: not assessed; confirm the selected release and contract.
Project deployment instructions cover the application on AWS ECS / Fargate with external database, Redis and file storage. Model inference is separate; review model endpoints, egress and WebSocket/runtime limits.
Cloud evidence reviewed 2026-11-12. Full listing and qualifications
RAGFlow
Document understanding, knowledge ingestion and retrieval-augmented/agentic question answering with configurable LLM, embedding and reranking endpoints.
Deployment options include customer AWS, Azure and Google Cloud infrastructure, Alibaba Compute Nest, and a Railway project. The evidence trail identifies the publishers and template versions. Hosting RAGFlow does not automatically self-host its LLM, embeddings or reranker; choose private or local model endpoints where required.
- Community RAGFlow deployment on AWS ECS Fargate through stdapi.ai ↗
Community template · Reviewed 2026-11-12 · Scope: Community / upstream open-source; third-party distribution where noted · Version: 0.26.4. Vendor support commitment: not assessed; confirm the selected release and contract.
The sample provisions the RAGFlow application and workers, OpenSearch, Aurora PostgreSQL, Valkey, S3 and a Bedrock gateway in the customer AWS account. Source inspection confirms the v0.26.4 Python image pin; it does not establish compatibility with the 1.0 Go rewrite. This community integration also requires the separately billed stdapi.ai gateway and Bedrock access. Review its documented networking, client-security, availability and cost limitations before use.
Cloud evidence reviewed 2026-11-12. Full listing and qualifications
Deployment and procurement checks
- Private offers
- AWS Marketplace private offers can contain negotiated pricing and terms for a buyer account. Confirm the product delivery model and your agreement; commitment credit is not established by a directory badge. Provider source ↗ · Reviewed 2026-11-14
- Private connectivity
- PrivateLink provides private endpoints to supported services and resources across VPC/account boundaries. Confirm that the selected product exposes a compatible endpoint service. Provider source ↗ · Reviewed 2026-11-14
- Cross-account operations
- Use an IAM role with scoped permissions and a third-party external ID where applicable. Review the trust principal, support access and revocation separately from installation access. Provider source ↗ · Reviewed 2026-11-14
- Government environments
- AWS GovCloud (US) is a distinct isolated-region environment. A commercial-region product deployment does not establish availability or certification there. Provider source ↗ · Reviewed 2026-11-14
For every provider, confirm marketplace/private-offer terms, commitment eligibility, regional service availability, private connectivity and any vendor access against your selected deployment. Provider capabilities do not automatically establish application support.
Plan this deployment
Account boundary: AWS account. Access: IAM roles and policies. Network: VPC.
Provider documentation ↗ · Guidance reviewed 2026-11-10. Confirm the application edition, region, support access, backup locations and operating responsibilities before choosing.
Compare this category across clouds · Search these listings · Compare 2–4 listings