Show HN: Moe-Direct – MoE Models far larger than your RAM, on a consumer desktop
Moe-Direct enables running MoE models larger than your RAM on a consumer desktop, saving resources and speeding up prototyping. Start by integrating the library
Original source