
# SGLang

Model-serving framework for running supported language and multimodal models on customer-controlled compute.

Canonical page: https://launchinyourcloud.com/directory/sglang/
Catalog revision: 170de95bb7d832897d269051ad4500713acf96a62f3d01bc1d4e649679a56fde




Named clouds have provider-specific evidence. Missing clouds do not establish incompatibility. Preserve edition, account boundary, operating responsibilities and publisher disclosures. Source review dates record human checks, not rebuilds.


1 listing.


## SGLang

Model-serving framework for running supported language and multimodal models on customer-controlled compute.

- Listing: https://launchinyourcloud.com/directory/sglang/
- Publisher listing: No
- Entry kind: product
- Documented cloud IDs: gcp
- Operating model: Customer-operated
- Infrastructure IDs: servers
- License: Apache License 2.0 for upstream SGLang. Model weights and hardware/runtime dependencies have their own licenses.
- Licensing model: open-source
- Installation: Install the package or use official containers; the reviewed primary installation path targets Linux with supported NVIDIA GPUs and compatible drivers.
- Architecture: Customer-operated inference server and model weights on configured accelerator hosts
- Operations: Customer manages accelerator capacity, model artifacts, runtime compatibility, endpoint access, including isolation of debug and dumper routes, monitoring, and upgrades.
- Product website: https://sglang.io/
- Source review: 2026-11-16; cloud review: 2026-11-12; licensing review: 2026-11-10; infrastructure review: 2026-11-10

### Scope and qualifications

Model downloads may require external registries and gated-model credentials. Pin compatible model/runtime/image versions and review model-specific permissions. Generic container instructions do not establish deployment badges for every hyperscaler. CVE-2026-111391 rates SGLang 0.5.10 through 0.5.22 critical (CVSS v4.0 9.2) for Python code execution through the debug dumper filter. The upstream report demonstrates the shared-API path with DUMPER_SERVER_PORT=reuse: an ordinary API-key holder can reach it when no separate admin API key is configured; access can be anonymous when no API key is configured. With an admin API key configured, that key is required. Exploitation also requires access to the dumper configuration and a subsequent model execution that reaches a dumper hook. Upstream issue #44188 remains open, and the v0.5.23 tag still contains the eval-based filter path even though that tag is outside the CVE record's enumerated affected range. Do not enable or expose the debug dumper endpoint; restrict it at the network layer and verify an upstream fix before treating a later version as remediated.

Apache License 2.0 for upstream SGLang. Model weights and hardware/runtime dependencies have their own licenses. This classification covers the reviewed upstream edition; external services and dependencies retain their own terms.

Customer-operated inference server and model weights on configured accelerator hosts. This is a customer-operated server/container deployment; portability does not establish named cloud-provider support.


### Category fit

- ai-inference-gateways: Model-serving framework for LLM and multimodal inference; an inference runtime rather than a full multi-provider governance gateway.

- ai-tools: Customer-operated inference infrastructure for serving supported model weights.

### Deployment boundaries


- gcp: Customer cloud account; Customer-operated; control plane: not-assessed. Source: https://docs.cloud.google.com/kubernetes-engine/docs/how-to/setup-multicluster-inference-gateway (checked 2026-11-12). 


### Cloud deployment evidence

- SGLang compatibility with GKE Inference Gateway (gcp): https://docs.cloud.google.com/kubernetes-engine/docs/how-to/setup-multicluster-inference-gateway
  Google explicitly supports SGLang as an alternative model server in its customer-operated multi-cluster GKE inference architecture. The worked manifests use vLLM; SGLang requires its own deployment, serving port, metric mapping and compatible Endpoint Picker image. Review GPU/model requirements, licenses and resource availability.
  Source type: provider-guide; reviewed: 2026-11-12; vendor support: not-assessed.


### Community and maintenance

The upstream release history documents hundreds of pull requests from many named contributors and sustained releases; its README describes production use across labs, platforms and enterprises.

Reviewed 2026-11-10.

- Release maintenance and contributor participation: https://github.com/sgl-project/sglang/releases

- Project and production-use context: https://raw.githubusercontent.com/sgl-project/sglang/main/README.md

### Sources

- Official installation and runtime: https://docs.sglang.io/docs/get-started/install

- Upstream project and capabilities: https://github.com/sgl-project/sglang

- Current upstream license: https://raw.githubusercontent.com/sgl-project/sglang/main/LICENSE

- CVE-2026-111391 debug dumper filter code injection: https://nvd.nist.gov/vuln/detail/CVE-2026-111391

- Upstream SGLang dumper-filter RCE issue: https://github.com/sgl-project/sglang/issues/44188

- SGLang v0.5.23 debug dumper implementation: https://github.com/sgl-project/sglang/blob/v0.5.23/python/sglang/srt/debug_utils/dumper.py#L1309-L1320

- CVE-2026-111391 primary record and affected-version range: https://cveawg.mitre.org/api/cve/CVE-2026-111391

### Licensing sources

- https://raw.githubusercontent.com/sgl-project/sglang/main/LICENSE

### Infrastructure sources

- https://docs.sglang.io/docs/get-started/install


### Buyer diligence


Research coverage: 6/12 fields (50%); 4 documented, 2 unresolved. Coverage is not a feature score.

Unrecorded fields are not researched, not a statement that the feature is unavailable. Sources checked — unresolved means the cited material did not establish an answer. Hosted-service certifications do not automatically cover customer installations.


- Marketplace delivery: Not researched.

- Cloud commitment eligibility: Not researched.

- Single sign-on: Sources checked — unresolved. Server arguments document inference and administrative API keys with separate endpoint rules. The reviewed upstream configuration does not establish SAML/OIDC login, user provisioning or a supported IdP integration. Confirm a gateway-based identity design instead of treating a static API key as SSO. Scope: Upstream inference-server/API authentication; federation unresolved. Source: https://docs.sglang.ai/advanced_features/server_arguments.html (reviewed 2026-11-20).

- SCIM provisioning: Not researched.

- Compliance attestations: Not researched.

- Security controls: Documented. The reported shared-API dumper exposure requires DUMPER_SERVER_PORT=reuse and access to configure a filter followed by a model execution. Without a separate admin key, an ordinary API key can reach the route; without any API key, it can be anonymous. A configured admin key is required when present. Keep dumper/debug routes disabled or network-isolated. The CVE enumerates 0.5.10–0.5.22; retained filter code in 0.5.23 is not by itself a complete assessment of every authentication configuration. Scope: Debug dumper trust boundary and deployment precautions; not a blanket claim that all SGLang endpoints or all later releases are unauthenticated. Source: https://github.com/sgl-project/sglang/issues/44188 (reviewed 2026-11-16). Supporting source: Primary CVE record — https://cveawg.mitre.org/api/cve/CVE-2026-111391. Supporting source: SGLang v0.5.23 shared dumper route and authentication level — https://github.com/sgl-project/sglang/blob/v0.5.23/python/sglang/srt/entrypoints/http_server.py. Supporting source: SGLang v0.5.23 filter implementation — https://github.com/sgl-project/sglang/blob/v0.5.23/python/sglang/srt/debug_utils/dumper.py#L1309-L1320.

- Air-gapped operation: Not researched.

- Deployment artifact / IaC: Documented. The upstream installation guide supplies container, Compose and Kubernetes options for model serving. Match model/backend, accelerator drivers and selected image; examples do not establish a universal GPU or memory minimum. Scope: Upstream self-hosted deployment; not a provider support or production-readiness certification. Source: https://docs.sglang.io/docs/get-started/install (reviewed 2026-11-14).

- Minimum footprint / sizing: Sources checked — unresolved. The server configuration sizes model loading, quantization, parallelism, KV cache and admitted requests through memory controls such as mem-fraction-static. It does not establish one safe CPU/RAM/VRAM minimum. Select model, precision, context, concurrency and availability, then validate the chosen accelerator topology. Scope: Model and serving-configuration dependent; complete production footprint unresolved. Source: https://docs.sglang.ai/advanced_features/server_arguments.html (reviewed 2026-11-20).

- License pricing: Documented. The reviewed upstream core is Apache-2.0 licensed. Optional services, bundled dependencies, commercial distributions and support can have separate terms. This records the source licence, not an infrastructure or operating-cost estimate. Model weights and external model APIs require their own review. Scope: Upstream core licence; commercial features, support and hosting priced separately. Source: https://raw.githubusercontent.com/sgl-project/sglang/main/LICENSE (reviewed 2026-11-20).

- Operating cost estimate: Not researched.

- Release snapshot / cadence: Documented. The publisher-designated GitHub release checked was v0.5.23, published 2026-11-02. This is a release snapshot, not a promised cadence, support designation or approval to substitute it into a provider package. Scope: Upstream sgl-project/sglang release record; commercial editions and deployment packages may differ. Source: https://github.com/sgl-project/sglang/releases/tag/v0.5.23 (reviewed 2026-11-14).




### Security and lifecycle reviews

Selected editorial reviews only; no flag does not mean safe or supported.

- SGLang debug dumper code execution (security-advisory): CVE-2026-111391 identifies code execution in the debug dumper filter. Check the debug endpoint exposure and authentication boundary. Scope: CVE record: SGLang 0.5.10–0.5.22. The open upstream report and reviewed v0.5.23 code do not establish a fixed release. Conditions: Requires dumper configuration access and a subsequent model execution reaching a dumper hook. In shared-API mode, an ordinary API key can suffice without a separate admin key; authentication configuration changes exposure. Action: Disable or isolate debug dumper endpoints and verify an upstream fix before treating a newer release as remediated. Source: https://cveawg.mitre.org/api/cve/CVE-2026-111391; reviewed 2026-11-16. Supporting source: Upstream report and authentication conditions — https://github.com/sgl-project/sglang/issues/44188. Supporting source: Reviewed v0.5.23 filter implementation — https://github.com/sgl-project/sglang/blob/v0.5.23/python/sglang/srt/debug_utils/dumper.py#L1309-L1320.



