AI tools & infrastructure
AI applications, model operations, inference and supporting vector databases.
31 listings, including 31 from other publishers. Entries cover the deployment options documented on their individual pages.
Read this page as JSON or Markdown.
Watch this category with RSS · Build a requirements shortlist
Deployment comparison
| Listing | Documented clouds | Deployment and infrastructure | Licensing | Installation | Operations and limitations |
|---|---|---|---|---|---|
| AnythingLLM Docker | AWS, Google Cloud, Railway | Customer-operated Servers / containers | Open Source / Open Core MIT License for upstream AnythingLLM; model weights, connectors and provider services have separate terms. | Run the official Docker edition on a customer-operated host with persistent application storage and configured model/vector endpoints. | Customer manages users, documents, persistent storage, model access, integration secrets, backups and upgrades.Scope and evidenceThe Docker edition supports multi-user operation and differs from the desktop application. Local inference is an option; configured external LLMs, embeddings, vector stores and agent tools can send data outside the account. AnythingLLM v1.20.0 hardens embed history, extension API-key authorization, workspace-agent access, password recovery, framing, and document-tool downloads. Optional MCP identity forwarding creates a new outbound identity path; keep the server and extension on compatible 1.20+ versions.
Cloud evidence reviewed 2026-11-12 |
| Arize Phoenix Self-Hosted | AWS, Azure, Google Cloud, Railway, Render | Customer-operated Servers / containers | Source Available Elastic License 2.0; includes restrictions on providing the software as a hosted/managed service and on license-key circumvention. This is source-available. | Use the official self-hosted Docker/Compose or Kubernetes deployment instructions and configure persistent storage and instrumentation endpoints. | Customer manages trace capture, storage, authentication, retention, evaluation providers, backups and upgrades.Scope and evidenceThe self-hosted product is distinct from commercial Arize offerings. Traces may contain prompts and outputs; evaluation jobs can call separately configured external model services even when trace storage is local.
Cloud evidence reviewed 2026-11-12 |
| Cloudera on Cloud | AWS, Azure, Google Cloud | Shared operations · vendor control plane Servers / containers | Commercial Only Commercial Cloudera subscription with cloud infrastructure charges paid separately. | Register the customer cloud environment and credentials, then provision Cloudera workload services through the control plane | Cloudera operates the service control plane; the customer owns cloud resources, credentials, data governance, network integration, workload sizing and shared operational responsibilities.Scope and evidenceThis entry covers Cloudera's public-cloud BYOC service, not a fully customer-operated software distribution. Workloads and data run in the customer's AWS, Azure or Google Cloud environment while Cloudera operates the control plane. Service availability and implementation details differ by provider, especially on Google Cloud, so confirm each required service before procurement. Cloudera November bulletins cover critical Brotli CVE-2026-111497 and compromised eMudhra certificates. Use the TSB matrices for the exact Runtime or Private Cloud Base component and fixed build rather than applying a generic platform version.
Cloud evidence reviewed 2026-11-17 |
| Dataiku DSS Cloud Stacks | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Commercial Only Commercial Dataiku license or license token required for the full Cloud Stacks capabilities. | AWS CloudFormation, Azure ARM template or Google Cloud Infrastructure Manager with Terraform | Customer manages cloud accounts, Fleet Manager, IAM identities, networking, VM and Kubernetes capacity, storage, TLS, backups, upgrades and license configuration.Scope and evidenceThis entry covers Dataiku Cloud Stacks, not vendor-hosted Dataiku Cloud. Dataiku states that Cloud Stacks resources run in the customer's organization or tenant and that Dataiku does not have access to customer data. Fleet Manager requires broad cloud permissions and outbound access for images, license validation and configured identity services. Dataiku DSS Free Edition is separate from the fully featured licensed Cloud Stacks deployment.
Cloud evidence reviewed 2026-11-16 |
| Dify Self-Hosted | Alibaba Cloud | Customer-operated Servers / containers | Source Available Modified Apache 2.0 terms; multi-workspace service operation and frontend branding can require commercial authorization. | Official Docker Compose deployment; pin a release and configure its required services. | Customer operates the containers, persistent stores, secrets, backups and upgrades; commercial edition support varies.Scope and evidenceSelf-hosting Dify does not itself host every model used by a flow. Model-provider plugins, embedding services, tools and connectors may send inputs or retrieved content outside the deployment. Select local endpoints where required and review each dependency. This entry does not conflate the generic self-hosted stack with the separately licensed AWS Premium edition. Dify 1.20.0 changes deployment and API behavior: OPENAPI_ENABLED defaults to true, shared.env is retired, six migrations apply from 1.19, and HITL, plugin-daemon, OpenShell, and optional file-scanning requirements change. It also fixes OAuth callback reuse, member-role enforcement, vector deletion scope, public stream detail exposure, and CVE-2026-116591.
Cloud evidence reviewed 2026-11-12 |
| Elastic Cloud on Kubernetes | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Source Available Elastic License 2.0 distribution with free Basic capabilities; Enterprise licensing unlocks additional features and support. | Official ECK Helm chart or Kubernetes manifests on EKS, AKS or GKE | Customer manages Kubernetes, storage, resource sizing, security, snapshots, upgrades and availability; Elastic licensing controls advanced features and support.Scope and evidenceThis entry covers self-managed Elastic Cloud on Kubernetes, not Elastic Cloud Hosted or Elastic Cloud Enterprise. ECK automates application lifecycle but does not transfer cluster, storage, backup or upgrade responsibility to Elastic. The free Basic license and paid Enterprise feature set differ; optional Cloud Connect services create separate external dependencies. ECK 3.5.0 fixes service-token exposure, cross-namespace certificate injection, and retained cross-namespace credentials. CVE-2026-72648 has no workaround; after upgrading, rotate the affected service token as Elastic directs.
Cloud evidence reviewed 2026-11-17 |
| Hyperscience Hypercell | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Commercial Only Commercial proprietary licence; product, user, database and support entitlements must be agreed for the selected installation. | Helm / Kubernetes operator; Kubernetes manifests | Customer operates the application and its cloud resources, including secrets, backups, monitoring and upgrades. Review any support access and configured external services; preserve application data, configuration and keys for migration or exit.Scope and evidenceThe Helm guide supplies complete AWS and GCP values, including application storage permissions. Registry integration alone is not a hosting badge. Hypercell application versions, Helm charts and Kubernetes support dates are separate. The October 2026 decoder advisory and the current v44 flow/block upgrade instructions must be checked before exposing document processing; hosted FedRAMP claims do not transfer to this installation. The vendor Azure reference diagram depicts the complete platform, Blob storage and PostgreSQL; its namespace label still says GKE, so validate the Azure-specific values with the vendor. Apply the fix for the installed Hypercell line and follow the documented sequential upgrades or temporary workarounds.
Cloud evidence reviewed 2026-11-19 |
| KNIME Business Hub | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Commercial Only Commercial KNIME Business Hub license or Marketplace software subscription required. | Official AWS, Azure or Google Cloud Marketplace virtual-machine image | Customer manages the cloud account, virtual machine, networking, DNS, TLS, identity, storage, backups, capacity, upgrades and Business Hub license.Scope and evidenceThis entry covers customer-hosted KNIME Business Hub, not the open-source KNIME Analytics Platform or KNIME's managed Hub offering. Marketplace deployments use single VM images; production capacity, availability and recovery requirements must be assessed separately. Customer-provisioned Kubernetes installation requires the applicable Self Hosted Premium package. Cloud infrastructure charges are separate from KNIME software pricing.
Cloud evidence reviewed 2026-11-16 |
| Langflow Self-Hosted | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Open Source / Open Core MIT for the upstream project; connected models, providers and bundles have their own terms. | Official Docker image or Docker Compose; Python installation and Kubernetes options are also documented. | Customer manages the application, database, access controls, installed components, backups and version upgrades.Scope and evidenceThe reviewed model-component docs support Ollama and configurable OpenAI-compatible endpoints as well as commercial providers. External models, embeddings, tools or custom components can move data beyond the host. Hosting Langflow is distinct from hosting those dependencies and from any vendor-managed service. Langflow 1.13.3 enforces custom-component policy in background workflows, invalidates native sessions after password changes, updates security dependencies, and aligns Docker and wheel packaging. Recheck custom components and session behavior after upgrading.
Cloud evidence reviewed 2026-11-12 |
| Langfuse Self-Hosted | AWS, Azure, Google Cloud, Railway, Render | Customer-operated Servers / containers | Open Source / Open Core MIT core; designated enterprise directories and add-on capabilities use separate license terms or keys. | Docker Compose for a single VM; Helm/Kubernetes and official AWS, Azure and Google Cloud Terraform modules. | Customer operates the deployment, persistence, access policies, retention, backups and scaling.Scope and evidenceTraces can contain prompts, outputs and other sensitive application data, so configure capture and retention deliberately. Self-hosted trace storage does not move the underlying application model into the same account. Optional model-based evaluators or the gateway use configured providers, which may be external. The single-VM Compose example does not provide production high availability or backups. Langfuse v4.82.0 fixes an SSRF path in GitHub Enterprise SSO and moves audit logs to ClickHouse. Review outbound SSO connectivity and audit-log storage during upgrade.
Cloud evidence reviewed 2026-11-12 |
| LibreChat Self-Hosted | Railway, DigitalOcean | Customer-operated Servers / containers | Open Source / Open Core MIT | Official Railway one-click template or Docker on a DigitalOcean Ubuntu Droplet | Customer manages the Railway project or DigitalOcean Droplet, application secrets, model credentials, data services, backups, scaling and upgrades. Railway operates its platform; Droplet users also maintain the operating system and Docker runtime.Scope and evidenceThe Railway path runs in the customer's project on platform-managed infrastructure; the DigitalOcean path uses a customer-operated Droplet. External model, embedding, search and tool providers receive data according to customer configuration. Review generated secrets, public networking, persistent data services and image updates before production use.
Cloud evidence reviewed 2026-11-15 |
| LiteLLM Proxy Self-Hosted | AWS, Azure, Google Cloud, Railway, Render | Customer-operated Servers / containers | Open Source / Open Core MIT outside the enterprise directory; enterprise code and features have separate license terms. | Official container image, Docker Compose or Kubernetes deployment; production infrastructure examples are documented. | Customer manages gateway availability, credentials, database, access policies, logs and upgrades, including pinning versions and verifying release artifacts with the documented version-appropriate Cosign method; model providers remain separate services.Scope and evidenceThe gateway forwards each request to its configured model provider. Self-hosting the proxy does not ensure prompts stay inside the account: external model APIs, guardrail services and logging integrations can receive data. Use appropriate self-hosted inference endpoints and explicitly review outbound integrations when required. For release integrity, release images and the Helm chart starting with v1.111.0-dev.3 use keyless Cosign signatures bound to LiteLLM's release workflow; earlier releases require the documented historical public keys. The October 21 incident affected PyPI v1.107.0 and Docker Hub/GHCR v1.107.0 plus mutable latest, main-latest and main-stable tags during the documented exposure windows. Check the incident's artifact digests and remediation instructions; the compromised images carried valid historical signatures, so signature verification alone does not establish safety. LiteLLM v1.110.0 changes authentication, guardrail, accounting, and S3 behavior. The 1.108.11 LTS patch also fixes Bedrock guarded_text handling and restricts os.environ team settings to proxy administrators; review both the selected release line and existing incident-response or image-signing guidance. LiteLLM v1.108.12 LTS fixes tool_policy allowing blocked /v1/messages tool names longer than 64 characters. The standard v1.110.1 UI image changes to slim nginx and removes curl while retaining wget and nc, so retest health probes and scripts that assume curl.
Cloud evidence reviewed 2026-11-12 |
| LocalAI | AWS | Customer-operated Servers / containers | Open Source / Open Core MIT License for upstream LocalAI. Model artifacts and inference backends can have different license and hardware requirements. | Run official CPU/GPU Docker images or the documented binaries and configure models, storage and endpoint access. | Customer manages models, backends, hardware capacity, API authentication, persistent storage and upgrades.Scope and evidenceCPU availability does not guarantee acceptable performance for every model. Model galleries and artifact downloads contact external registries; optional integrations and remote backends can change data boundaries.
Cloud evidence reviewed 2026-11-12 |
| MaxKB Community Edition | Alibaba Cloud | Customer-operated Servers / containers | Open Source / Open Core GNU General Public License version 3 for Community Edition. Professional and Enterprise editions add separately licensed features and support. | Create the documented MaxKB Community Edition service instance through Alibaba Cloud Compute Nest, or use the publisher-documented Alibaba Cloud Marketplace image on a customer ECS server. | Customer manages the ECS host, VPC and security-group exposure, administrator credentials, persistent PostgreSQL data, backups, upgrades, capacity and credentials for model and tool integrations.Scope and evidenceThe Compute Nest deployment requires RAM permissions with full access to ECS, VPC and ROS plus Compute Nest user access; review and reduce deployment privileges after provisioning where practical. Community Edition is single-tenant, x86-64 only and supports single-node or cold-standby deployment rather than Enterprise clustering. RBAC, SSO, audit logs, open API access, conversation-user authorization and several enterprise integrations are reserved for paid editions. Current upstream v2 installation guidance calls for at least 4 CPU cores, 8 GB RAM and 100 GB of disk, exposes the web service on port 8080 and supplies default administrator credentials that must be changed immediately. The publisher recommends offline installation for production and requires a database backup before upgrades. Public or separately hosted model, embedding, reranking and tool providers can receive application data even when MaxKB itself runs in the customer account. The current upstream v2 container image and persistence paths differ from the legacy English guide; check the release packaged by the cloud installer before applying upstream configuration or upgrades. MaxKB v2.10.9-lts fixes multiple cross-workspace access and deletion flaws, stored XSS with account-takeover impact, custom-tool secret exposure, SSRF paths including possible cloud-credential theft, anonymous provider API-key disclosure and unauthorized conversation or knowledge-base access. Upgrade the LTS line and retest workspace, tool and provider boundaries.
Cloud evidence reviewed 2026-11-16 |
| Milvus | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Open Source / Open Core Apache License 2.0 for upstream Milvus. | Run the official standalone Docker or versioned Docker Compose deployment; distributed deployments have separate operational requirements. | Customer manages persistent volumes, collections, indexes, access controls, capacity, backups and upgrades.Scope and evidenceCurrent installation scripts can track a different image than a selected stable release; use versioned configurations for reproducibility. Model inference and embedding generation are separate workloads. Managed Zilliz offerings are outside this listing.
Cloud evidence reviewed 2026-11-12 |
| Minute (i.AI) | AWS | Customer-operated Servers / containers | Open Source / Open Core MIT for the reviewed upstream edition; optional commercial services and bundled components have separate terms. | Terraform | Customer operates the application and its cloud resources, including secrets, backups, monitoring and upgrades. Review any support access and configured external services; preserve application data, configuration and keys for migration or exit.Scope and evidenceThe project is explicitly in incubation. Government and council reports establish pilot use; the public Terraform depends on environment, identity and shared-platform resources that an adopting organization must supply. Azure Speech and language-model calls can send recording or transcript data outside the AWS application boundary. Human review remains necessary for formal minutes.
Cloud evidence reviewed 2026-11-19 |
| MLflow Tracking Server Self-Hosted | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Open Source / Open Core Apache 2.0 for upstream MLflow; connected model providers and managed distributions have separate terms. | Python MLflow server command, official Docker Compose bundle or Kubernetes Helm deployment. | Customer operates server access, metadata and artifact stores, retention, backups, scaling and version upgrades.Scope and evidenceTraces can capture model inputs, outputs and intermediate metadata. Point clients at the customer-hosted server and review recording/redaction settings. Applications, evaluators and optional model integrations may still call external providers; hosting the tracking server does not host all training or inference runtimes. Production database, storage and security configuration differ from a local quickstart.
Cloud evidence reviewed 2026-11-12 |
| n8n Self-Hosted | AWS, Azure, Google Cloud, DigitalOcean, Heroku, Hetzner | Customer-operated Servers / containers | Source Available Sustainable Use License for covered code; separate commercial Enterprise license for enterprise components | Docker Compose with persistent data; database and worker topology selected for workload | Customer manages servers/containers, secrets, database, backup/restore, scaling and upgrades.Scope and evidenceThis entry excludes n8n Cloud. The Sustainable Use License has use restrictions and should not be described as unrestricted open-source licensing. Enterprise components require the appropriate commercial license. External integrations, AI providers and optional assistant services require separate data-flow review. n8n@2.48.6 and the maintained n8n@1.123.99 line move official images to patched Node runtimes carrying a V8 process-abort fix. The 1.x image also moves to Node 24.22.3, while 2.x pins a patched Node 26.13.0. Update the selected line and verify custom images use the fixed runtime.
Cloud evidence reviewed 2026-11-12 |
| NVIDIA AI Enterprise | AWS, Azure, Google Cloud, Oracle Cloud, Alibaba Cloud, Tencent Cloud, Volcano Engine | Customer-operated Servers / containers | Commercial Only Commercial NVIDIA AI Enterprise subscription, consumption or perpetual license; most customer-cloud paths require BYOL. | NVIDIA AI Enterprise or GPU-optimized cloud VM images, standard instances with BYOL, or managed Kubernetes on supported cloud providers | Customer manages cloud GPU instances or Kubernetes, drivers, GPU Operator and container runtime, networking, storage, identities, NGC access, model services, monitoring, upgrades and license activation.Scope and evidenceThis entry covers customer-operated NVIDIA AI Enterprise software, not a managed AI service. A license is required and is not included with most standard, GPU-optimized VMI or managed-Kubernetes deployments; on-demand NVIDIA AI Enterprise VMIs and private offers use separate included-license processes. Not every component is available on every cloud or deployment model. GPU deployments are generally licensed per GPU, while CPU-only instances require an instance license. Tencent Cloud and ByteDance Volcano Engine have documented standard-instance BYOL paths. These guides require certified software and supported instance types; they do not establish that every GPU, component or provider image is eligible. Their per-instance wording differs from the general per-GPU licensing guidance, so confirm the applicable licensing unit. The November lifecycle matrix lists active 9.0/R620, 8.3/R595, and 7.9 LTSB/R580 branches with different end dates. NeMo Microservices support ended October 1, 2026, after 25.12 became the final GA release; select and patch each component branch independently.
Cloud evidence reviewed 2026-11-16 |
| Onyx Self-Hosted | AWS, Azure, Google Cloud, DigitalOcean | Customer-operated Servers / containers | Open Source / Open Core MIT Community Edition; Business and Enterprise features use separate commercial terms. | Docker Compose on a VM or official Kubernetes and Terraform deployment | Customer manages application services, databases, search, object storage, connectors, model credentials, backups, scaling and upgrades.Scope and evidenceThis entry covers self-hosted Onyx, not a vendor-hosted environment. External LLM, embedding and connector services receive data according to the customer's configuration. Business and Enterprise features and support require separate commercial entitlements.
Cloud evidence reviewed 2026-11-14 |
| Open WebUI Self-Hosted | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Source Available Open WebUI license based on BSD-style terms with additional branding restrictions and defined exceptions; enterprise terms may be required for rebranding. | Official Docker image, Python installation or Kubernetes deployment. | Customer runs application storage, authentication, provider configuration, updates and backups.Scope and evidenceThe UI sends messages to the model endpoint selected for a conversation. Local Ollama or vLLM endpoints can keep inference on customer infrastructure; cloud APIs, embeddings, tools and plugins have separate data flows. The current license restricts branding removal in larger deployments, with small-deployment, permission and enterprise-license exceptions; review the actual terms. Open WebUI v0.13.4 replaces Direct Connections and Integrations with Tether and migrates image settings. Deployments using Terminals server connections require Terminals 0.4.0 or later; upgrading that server from 0.3.x requires manual migration. Open Terminal and Tether terminal connections are unaffected by this migration. Tether introduces user-device and local-command paths that require explicit trust review.
Cloud evidence reviewed 2026-11-12 |
| OpenLIT | DigitalOcean | Customer-operated Servers / containers | Open Source / Open Core Apache License 2.0 for upstream OpenLIT. Models and external integrations have separate terms. | Run the official Docker Compose platform or documented Kubernetes deployment with its persistent telemetry services. | Customer manages telemetry collection, analytical storage, capture policies, access controls, retention and upgrades.Scope and evidenceConfigure instrumentation to send telemetry to the self-hosted receiver. Optional LLM-based evaluations and integrations can call external services; hosting the observability platform does not host every model being observed.
Cloud evidence reviewed 2026-11-12 |
| OpenSearch | Railway | Customer-operated Servers / containers | Open Source / Open Core Apache License 2.0 for upstream OpenSearch. Separately operated managed services and connected model or data services have their own terms. | Run official Docker images and customize the documented Docker Compose examples; native package and tarball installations are also documented. | Customer manages cluster sizing, storage, shard and replica layout, TLS, users and roles, ingestion, snapshots, monitoring and upgrades.Scope and evidenceSample deployments and demo security settings require production configuration. Official images distributed through Amazon ECR are not evidence of an AWS-specific deployment. The listing covers self-operated OpenSearch; Amazon OpenSearch Service and other managed services are separate delivery models. Embeddings and AI connectors can involve external models or services. OpenSearch 3.10.0 removes experimental Views and macOS x64 archives and fixes remote-store data-loss or stall paths, bulk-index corruption, heap leaks, snapshot queue stalls, remote-translog issues, and OOM behavior. Validate plugins, Dashboards, and storage recovery before upgrading.
Cloud evidence reviewed 2026-11-12 |
| Qdrant Self-Hosted | Google Cloud | Customer-operated Servers / containers | Open Source / Open Core Apache 2.0 for the upstream database; managed cloud offerings and support have separate commercial terms. | Official Docker image for local/server deployment; production storage, access controls and scaling require configuration. | Customer manages persistence, backups, access controls, upgrades and any distributed-cluster operations.Scope and evidenceThe local quickstart is an installation starting point, not a secured production configuration. Applications can supply their own vectors or use separately configured embedding models. External embedding APIs and hosted inference can receive source data even when the database is self-hosted; local FastEmbed is a documented alternative. This entry excludes Qdrant Cloud hosting. Qdrant 1.20.1, released November 13, 2026, prevents collection-scoped JWTs from viewing snapshot telemetry for collections they cannot access; operators using scoped JWTs should upgrade.
Cloud evidence reviewed 2026-11-12 |
| RAGFlow | AWS, Azure, Google Cloud, Alibaba Cloud, Railway | Customer-operated Servers / containers | Open Source / Open Core Apache License 2.0 for upstream RAGFlow; models, data assets and dependencies retain their own terms. | Versioned upstream Docker Compose, provider-specific VM packages or community deployment templates; select a path compatible with the intended RAGFlow release. | Customer manages document storage, indexing, app services, access controls, model endpoints, backups and upgrades.Scope and evidenceDeployment options include customer AWS, Azure and Google Cloud infrastructure, Alibaba Compute Nest, and a Railway project. The evidence trail identifies the publishers and template versions. Hosting RAGFlow does not automatically self-host its LLM, embeddings or reranker; choose private or local model endpoints where required.
Cloud evidence reviewed 2026-11-12 |
| Red Hat OpenShift AI Self-Managed | AWS, Azure, Google Cloud, Oracle Cloud, IBM Cloud | Customer-operated Servers / containers | Commercial Only Commercial Red Hat OpenShift AI Self-Managed subscription; an eligible OpenShift subscription is also required. | OpenShift AI Operator through OperatorHub or the oc command-line interface | Customer manages the OpenShift cluster, storage, accelerators, identity, networking, model data, backups and upgrades within Red Hat's supported configuration matrix.Scope and evidenceThis entry covers OpenShift AI Self-Managed, not Red Hat's managed cloud-service add-on. Support depends on a compatible OpenShift Container Platform release, storage and accelerator matrix, and active subscriptions. Underlying OpenShift and cloud infrastructure are operated by the customer. RHSA-2026:95872 is a critical OpenShift AI 3.5.3 security update covering nine CVEs. Use Red Hat's package and deployment scope to determine affected components, then apply 3.5.3 or a later supported update.
Cloud evidence reviewed 2026-11-17 |
| SAS Viya Platform | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Commercial Only Commercial SAS Viya licensing; deployment assets and a JWT license are delivered for the customer's software order. | Provision EKS, AKS or GKE with SAS Terraform projects, then deploy Kubernetes manifests generated through Kustomize and SAS automation | Customer manages Kubernetes, networking, ingress, storage, PostgreSQL, identity, sizing, backups, platform updates and licensed deployment assets.Scope and evidenceThe public SAS infrastructure repositories are Apache-licensed deployment tooling; SAS Viya itself is commercial software and requires licensed order assets and a JWT license. Kubernetes and PostgreSQL are mandatory. SAS states that its infrastructure-as-code projects satisfy most, not all, deployment requirements. The viya4-deployment project can patch the same manifest but does not move an installation to a different cadence, version or software offering. SAS November bulletins cover compromised eMudhra certificates and critical Brotli CVE-2026-111497 across specified Viya branches. Use the vendor matrices to identify the exact affected component and fixed maintenance level; do not treat a generic Viya version as sufficient.
Cloud evidence reviewed 2026-11-17 |
| SGLang | Google Cloud | Customer-operated Servers / containers | Open Source / Open Core Apache License 2.0 for upstream SGLang. Model weights and hardware/runtime dependencies have their own licenses. | Install the package or use official containers; the reviewed primary installation path targets Linux with supported NVIDIA GPUs and compatible drivers. | Customer manages accelerator capacity, model artifacts, runtime compatibility, endpoint access, including isolation of debug and dumper routes, monitoring, and upgrades.Scope and evidenceModel downloads may require external registries and gated-model credentials. Pin compatible model/runtime/image versions and review model-specific permissions. Generic container instructions do not establish deployment badges for every hyperscaler. CVE-2026-111391 rates SGLang 0.5.10 through 0.5.22 critical (CVSS v4.0 9.2) for Python code execution through the debug dumper filter. The upstream report demonstrates the shared-API path with DUMPER_SERVER_PORT=reuse: an ordinary API-key holder can reach it when no separate admin API key is configured; access can be anonymous when no API key is configured. With an admin API key configured, that key is required. Exploitation also requires access to the dumper configuration and a subsequent model execution that reaches a dumper hook. Upstream issue #44188 remains open, and the v0.5.23 tag still contains the eval-based filter path even though that tag is outside the CVE record's enumerated affected range. Do not enable or expose the debug dumper endpoint; restrict it at the network layer and verify an upstream fix before treating a later version as remediated.
Cloud evidence reviewed 2026-11-12 |
| Strategy Enterprise in Your Cloud | AWS, Azure, Google Cloud, STACKIT | Vendor-operated BYOC Servers / containers | Commercial Only Commercial Strategy Enterprise subscription; customer-cloud deployment is not available with the Standard plan. | Vendor-assisted, fully managed deployment into the customer's licensed AWS, Azure Google Cloud or STACKIT environment | Strategy administers and maintains the platform; the customer supplies the cloud environment, data sources, identity, network approvals and shared governance responsibilities.Scope and evidenceThis entry covers the Strategy Enterprise customer-cloud option, not Strategy Standard in the vendor's managed environment. Strategy describes the service as fully managed despite its deployment in a customer-licensed AWS, Azure Google Cloud or STACKIT environment, so it is classified as BYOC rather than fully customer-operated. Confirm contract-specific account ownership, cloud-resource billing, service availability, support boundaries and cloud-commitment eligibility before procurement.
Cloud evidence reviewed 2026-11-17 |
| vLLM Self-Hosted | AWS, Azure, Google Cloud | Customer-operated Servers / containers | Open Source / Open Core Apache 2.0 for vLLM; model weights and supporting dependencies have independent licenses and access conditions. | Official vLLM Docker image or supported Python installation; choose a compatible hardware/backend configuration. | Customer manages model acquisition, hardware capacity, endpoint protection, availability, upgrades and model/runtime compatibility.Scope and evidenceThis entry covers the inference server, not a hosted model service. It can run supported model weights on customer infrastructure, but those weights may need external downloads or access approval and are not licensed by vLLM. Review default usage telemetry and optional outbound integrations; hosting inference does not automatically create an air-gapped system. vLLM v0.34.0 removes Model Runner V1; configurations setting VLLM_USE_V2_MODEL_RUNNER=0 now fail at startup. It changes the default block size from 16 to 64, enables extensible KV cache by default with gpu_memory_utilization defaulting to 1.0, drops ROCm 7.2 wheels and images in favor of ROCm 10.0, requires huggingface_hub 2.0.0 or later, and removes QuTLASS/fp_quant and Marlin W4A8 support. Review the upstream breaking-change table and test model, quantization, memory, and accelerator compatibility before rollout.
Cloud evidence reviewed 2026-11-12 |
| Weaviate Self-Hosted | AWS, Google Cloud | Customer-operated Servers / containers | Open Source / Open Core BSD-3-Clause core outside the wl directory; wl code and associated enterprise features require a separate enterprise license/key. | Docker or Docker Compose, or a Kubernetes deployment using Helm. Google’s GKE guide uses Terraform to provision the cluster. | Customer manages authentication, storage, backup, scaling, configuration and upgrades.Scope and evidenceThe Docker defaults include anonymous access and default telemetry; production installations must configure the intended controls. Pre-vectorized data can be searched without an external vectorizer, but enabled embedding, reranking or generation integrations may call external providers. Telemetry is enabled by default and has a documented opt-out; the entire current codebase must not be described as uniformly BSD-licensed. Weaviate v1.39.17 fixes a v1.39 runtime-reindex restart bug in which writes arriving before reindex resumed could be absent from the new property index, or an incomplete index could be swapped in after partial files disappeared. Operators remaining on v1.39 should update and verify filter/search results; the primary reviewed release remains the newer v1.40.5 line.
Cloud evidence reviewed 2026-11-21 |
Choose 2–4 listings to compare
Browse listing cards
AI applications & RAG +1 more
AnythingLLM Docker
Self-hosted application for document-grounded AI chat, retrieval and agents.
- AWS
- Google Cloud
- Railway
Buyer facts and open questions →
4 sources checked
AI observability & LLMOps +1 more
Arize Phoenix Self-Hosted
AI observability and evaluation server for traces, datasets and application experiments.
- AWS
- Azure
- Google Cloud
- Railway
- Render
Buyer facts and open questions →
3 sources checked
Data & analytics +2 more
Cloudera on Cloud
Cloudera-managed control plane that provisions data, analytics and AI workload services into a customer's public-cloud account.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
6 sources checked
Data & analytics +1 more
Dataiku DSS Cloud Stacks
Commercial Dataiku DSS deployment managed through Fleet Manager inside a customer AWS, Azure or Google Cloud tenant.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
5 sources checked
AI applications & RAG +1 more
Dify Self-Hosted
Visual AI application and RAG workflow platform available as a self-hosted container stack.
- Alibaba Cloud
Buyer facts and open questions →
5 sources checked
Databases & vector +3 more
Elastic Cloud on Kubernetes
Elastic's Kubernetes operator for deploying and operating Elasticsearch, Kibana and related Elastic Stack resources in customer clusters.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
7 sources checked
Correspondence management +1 more
Hyperscience Hypercell
Commercial document-intake and extraction platform installed into customer Kubernetes infrastructure.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
9 sources checked
Data & analytics +1 more
KNIME Business Hub
Commercial workflow collaboration and automation platform launched from AWS, Azure or Google Cloud Marketplace VM images.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
5 sources checked
AI applications & RAG +1 more
Langflow Self-Hosted
Visual AI workflow and agent builder with Docker and persistent PostgreSQL deployment.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
4 sources checked
AI observability & LLMOps +2 more
Langfuse Self-Hosted
Self-hosted LLM observability, evaluations and prompt-management platform.
- AWS
- Azure
- Google Cloud
- Railway
- Render
Buyer facts and open questions →
10 sources checked
AI applications & RAG +1 more
LibreChat Self-Hosted
Self-hosted multi-model AI chat, agent and retrieval platform with documented Railway and DigitalOcean deployments.
- DigitalOcean
- Railway
Buyer facts and open questions →
5 sources checked
AI inference & gateways +1 more
LiteLLM Proxy Self-Hosted
Self-hosted AI API gateway providing model routing, access controls and usage tracking.
- AWS
- Azure
- Google Cloud
- Railway
- Render
Buyer facts and open questions →
10 sources checked
AI inference & gateways +1 more
LocalAI
Local model inference service exposing configurable AI capabilities through compatible API endpoints.
- AWS
Buyer facts and open questions →
3 sources checked
AI applications & RAG +1 more
MaxKB Community Edition
Open-source knowledge-base, RAG and agent-workflow platform deployable into an Alibaba Cloud account.
- Alibaba Cloud
Buyer facts and open questions →
10 sources checked
Databases & vector +1 more
Milvus
Vector database for similarity search and retrieval over embedding collections.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
3 sources checked
Board & committee governance +1 more
Minute (i.AI)
Open-source meeting transcription and minute generation developed for public-sector use.
- AWS
Buyer facts and open questions →
4 sources checked
AI observability & LLMOps +2 more
MLflow Tracking Server Self-Hosted
Self-hosted experiment tracking and LLM/agent observability with customer-controlled metadata and artifacts.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
3 sources checked
Workflow automation +1 more
n8n Self-Hosted
Automate integrations and business processes with a customer-hosted workflow editor and runtime.
- AWS
- Azure
- Google Cloud
- DigitalOcean
- Heroku
- Hetzner
Buyer facts and open questions →
10 sources checked
AI tools & infrastructure +1 more
NVIDIA AI Enterprise
Commercial enterprise AI software suite deployed on customer cloud GPU instances or managed Kubernetes clusters.
- AWS
- Azure
- Google Cloud
- Oracle Cloud
- Alibaba Cloud
- Tencent Cloud
- Volcano Engine
Buyer facts and open questions →
10 sources checked
AI applications & RAG +1 more
Onyx Self-Hosted
Self-hosted enterprise search and AI assistant platform with connectors and retrieval infrastructure.
- AWS
- Azure
- Google Cloud
- DigitalOcean
Buyer facts and open questions →
8 sources checked
AI applications & RAG +1 more
Open WebUI Self-Hosted
Self-hosted AI chat and knowledge interface for local model servers and cloud APIs.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
5 sources checked
AI observability & LLMOps +1 more
OpenLIT
OpenTelemetry-based AI tracing and evaluation platform for model and agent operations.
- DigitalOcean
Buyer facts and open questions →
3 sources checked
Databases & vector +3 more
OpenSearch
Distributed search and analytics engine with vector retrieval, operational-data analysis and OpenSearch Dashboards visualizations.
- Railway
Buyer facts and open questions →
7 sources checked
Databases & vector +1 more
Qdrant Self-Hosted
Self-hosted vector database for semantic retrieval and AI application data.
- Google Cloud
Buyer facts and open questions →
4 sources checked
AI applications & RAG +1 more
RAGFlow
Document processing and retrieval platform for building RAG and agentic knowledge applications.
- AWS
- Azure
- Google Cloud
- Alibaba Cloud
- Railway
Buyer facts and open questions →
3 sources checked
Red Hat OpenShift AI Self-Managed
Commercial AI and machine-learning platform installed as an Operator on a customer-operated Red Hat OpenShift cluster.
- AWS
- Azure
- Google Cloud
- Oracle Cloud
- IBM Cloud
Buyer facts and open questions →
3 sources checked
Data & analytics +1 more
SAS Viya Platform
Commercial analytics and AI platform deployed into a customer-operated managed Kubernetes cluster.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
9 sources checked
AI inference & gateways +1 more
SGLang
Model-serving framework for running supported language and multimodal models on customer-controlled compute.
- Google Cloud
Buyer facts and open questions →
7 sources checked
Data & analytics +1 more
Strategy Enterprise in Your Cloud
Vendor-managed enterprise analytics and AI platform deployed as a dedicated single-tenant environment in the customer's public-cloud account.
- AWS
- Azure
- Google Cloud
- STACKIT
Buyer facts and open questions →
5 sources checked
AI inference & gateways +1 more
vLLM Self-Hosted
Self-hosted model inference and serving engine with OpenAI-compatible APIs.
- AWS
- Azure
- Google Cloud
Buyer facts and open questions →
5 sources checked
Databases & vector +1 more
Weaviate Self-Hosted
Self-hosted vector-search database for retrieval and AI applications.
- AWS
- Google Cloud
Buyer facts and open questions →
6 sources checked
How these listings fit
- AnythingLLM Docker
- Self-hosted AI application interface and retrieval/agent integrations; model inference is separately configured.
- Arize Phoenix Self-Hosted
- AI development and operations tooling for tracing and evaluation rather than a model-serving runtime.
- Cloudera on Cloud
- Machine-learning and AI workload services are available within the Cloudera platform, subject to provider and subscription availability.
- Dataiku DSS Cloud Stacks
- Provides customer-operated data science, machine-learning, generative-AI, model-deployment and AI-governance capabilities.
- Dify Self-Hosted
- Visual AI application and RAG workflow platform available as a self-hosted container stack.
- Elastic Cloud on Kubernetes
- Vector search and licensed machine-learning capabilities support retrieval and AI-oriented workloads.
- Hyperscience Hypercell
- Commercial document-intake and extraction platform installed into customer Kubernetes infrastructure.
- KNIME Business Hub
- Provides customer-operated execution and governance for data-science, machine-learning and generative-AI workflows.
- Langflow Self-Hosted
- Visual AI workflow and agent builder with Docker and persistent PostgreSQL deployment.
- Langfuse Self-Hosted
- Self-hosted LLM observability, evaluations and prompt-management platform.
- LibreChat Self-Hosted
- Provides a self-hosted interface and orchestration layer for model endpoints, agents, MCP tools, authentication and administrative controls.
- LiteLLM Proxy Self-Hosted
- Self-hosted AI API gateway providing model routing, access controls and usage tracking.
- LocalAI
- Customer-operated model-serving infrastructure with CPU and optional accelerator backends.
- MaxKB Community Edition
- Customer-hosted agent and workflow platform with knowledge bases, MCP and tool integrations, and configurable language, embedding, reranking and multimodal models.
- Milvus
- Embedding storage and vector retrieval infrastructure for AI search and RAG applications.
- Minute (i.AI)
- Open-source meeting transcription and minute generation developed for public-sector use.
- MLflow Tracking Server Self-Hosted
- Self-hosted experiment tracking and LLM/agent observability with customer-controlled metadata and artifacts.
- n8n Self-Hosted
- Orchestrates AI providers, agents, tools and memory as workflows. Model inference and external service dependencies are configured separately.
- NVIDIA AI Enterprise
- Provides an enterprise-supported suite of AI frameworks, infrastructure software, operations components and development tools.
- Onyx Self-Hosted
- Provides self-hosted indexing, retrieval, model integration and agent services for building internal AI experiences.
- Open WebUI Self-Hosted
- Self-hosted AI chat and knowledge interface for local model servers and cloud APIs.
- OpenLIT
- AI instrumentation, evaluation and operational feedback tooling with a self-hosted platform.
- OpenSearch
- Vector storage, semantic search and retrieval for AI applications and RAG. Embedding generation and model connectors have separately configured runtimes and data flows.
- Qdrant Self-Hosted
- Self-hosted vector database for semantic retrieval and AI application data.
- RAGFlow
- Self-hosted document ingestion, retrieval and context infrastructure for AI applications.
- Red Hat OpenShift AI Self-Managed
- AI workbenches, pipelines, model serving and lifecycle tooling delivered on a customer-operated OpenShift platform.
- SAS Viya Platform
- Model development, machine learning, model management and AI operationalization; exact products depend on the licensed order.
- SGLang
- Customer-operated inference infrastructure for serving supported model weights.
- Strategy Enterprise in Your Cloud
- Enterprise includes customizable AI agents and AI-assisted analysis capabilities; exact features and model integrations follow the contracted platform.
- vLLM Self-Hosted
- Self-hosted model inference and serving engine with OpenAI-compatible APIs.
- Weaviate Self-Hosted
- Self-hosted vector-search database for retrieval and AI applications.
Review dates and sources appear on each listing. Functionality, edition, deployment and licensing must be checked together. Filter this category with cloud and deployment controls →