How do I run ChatGPT-style AI privately in my own cloud?
Read this page as JSON or Markdown.
Map every AI layer
- Identify where prompts, attachments, embeddings, vector data, responses and conversation history are processed and retained.
- Choose the actual inference endpoint and model license, and size the required CPU, GPU, memory and storage for that model and workload.
- Review gateway routes, credentials, plugins, web access, logs and observability exports. Test egress rather than inferring isolation from the user interface.
Start with a documented connection
The private AI stack page documents an Open WebUI and vLLM connection. A gateway is an alternative routing layer, not proof of local inference. A cloud badge for one component does not establish that all layers, models or optional services run on the same provider or can operate offline.
Explore the reviewed listings
Illustrative candidates, shown alphabetically. Read each listing’s sources, edition limits and operating responsibilities; this is not a ranking or a feature-parity claim.
LiteLLM Proxy Self-Hosted
Self-hosted AI API gateway providing model routing, access controls and usage tracking.
Customer-operated · Open Source / Open Core · Reviewed 2026-11-19. Read deployment evidence →
Open WebUI Self-Hosted
Self-hosted AI chat and knowledge interface for local model servers and cloud APIs.
Customer-operated · Source Available · Reviewed 2026-11-18. Read deployment evidence →
vLLM Self-Hosted
Self-hosted model inference and serving engine with OpenAI-compatible APIs.
Customer-operated · Open Source / Open Core · Reviewed 2026-11-17. Read deployment evidence →
Sources and further guidance
Answer reviewed 2026-11-21. Check the exact edition, configuration and current vendor terms before deciding.