Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Janas: Run LLMs larger than RAM by streaming experts from SSD

Janas enables running LLMs larger than RAM by streaming experts from SSD. To adopt it practically, first integrate it into a prototype, ensuring compatibility w

Original source