scaleapi/llm-engine

Scale LLM Engine is an open‑source backend framework designed to simplify the deployment, scaling, and management of large language models (LLMs) in production