Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

SonicBoom – llama.cpp's own kernels, 14% faster decode via a graph compiler

SonicBoom is llama.cpp’s own kernels that speed up decoding by 14 % using a graph compiler. Adopt it by first ensuring compatibility with your workflow, then ma

Original source