turboderp-org/exllamav3
**Project Summary** exllamav3 is an open-source library that optimizes quantization and inference for running Large Language Models (LLMs) on modern consumer-cl
Original source**Project Summary** exllamav3 is an open-source library that optimizes quantization and inference for running Large Language Models (LLMs) on modern consumer-cl
Original source