sgl-project/rbg — A workload for deploying LLM inference services on Kubernetes

Description and use

The **sgl‑project/rbg** repository provides a ready‑to‑run workload for deploying large language model (LLM) inference services on Kubernetes clusters. It includes Helm charts, Docker images, and example configurations that automate the provisioning, scaling, and monitoring of GPU‑accelerated inference pods, helping AI/ML teams streamline DevOps pipelines and production‑grade model serving.

Problem

sgl-project/rbg helps add AI capability without starting from a blank model stack.

Outcome

Early or unclear: treat as research material until maintenance, releases, docs, and issue activity are verified.

Workflow

• prototype AI features
• build RAG or agent workflows
• evaluate model tooling

Evidence

A workload for deploying LLM inference services on Kubernetes

Source