ModelCloud/GPTQModel — LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU…
ModelCloud/GPTQModel is an open‑source toolkit for quantizing (compressing) large language models, offering hardware‑accelerated inference across Nvidia, AMD, a