Show HN: Run faster MoE inference on Mac with less RAM
This project speeds up MoE inference on Macs while reducing RAM usage, making it ideal for running large models on laptops. To adopt, simply install the package
Original sourceThis project speeds up MoE inference on Macs while reducing RAM usage, making it ideal for running large models on laptops. To adopt, simply install the package
Original source