Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Glq a port trellis quantization of large language models as a vLLM plugin

Glq is a Trellis quantization port for large language models delivered as a vLLM plugin. It offers a quick way to compress models into existing pipelines, thoug

Original source