Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Show HN: Run faster MoE inference on Mac with less RAM

This project speeds up MoE inference on Macs while reducing RAM usage, making it ideal for running large models on laptops. To adopt, simply install the package

Original source