Glq a port trellis quantization of large language models as a vLLM plugin
Glq is a Trellis quantization port for large language models delivered as a vLLM plugin. It offers a quick way to compress models into existing pipelines, thoug
Original source