Janas: Run LLMs larger than RAM by streaming experts from SSD
说明与用途
Janas 通过从 SSD 流式加载专家来运行超出 RAM 大小的 LLM。实际采用时,先将其集成到原型中,验证与现有栈和依赖项的兼容性。该项目适用于原型和内部工作流程,但在投入生产前需进行手动审查。
实际用途
Janas: Run LLMs larger than RAM by streaming experts from SSD may be useful when its README and activity match a concrete workflow.
限制与审查说明
Medium: useful for prototypes or internal workflows, with dependency and maintenance checks before production.
- 来源: hackernews
- 记录日期: 2026-10-12T22:05:43.000Z