scaleapi/llm-engine — Scale LLM Engine public repository

Scale LLM Engine is an open‑source backend framework designed to simplify the deployment, scaling, and management of large language models (LLMs) in production