vllm-project/llm-compressor

The LLM Compressor is an open-source library that enables the efficient deployment of Large Language Models (LLMs) by applying various compression algorithms. C