ModelTC/LightLLM

ModelTC/LightLLM is a Python‑centric framework for inference and serving of large language models that emphasizes a minimal footprint and rapid response times.