Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Janas: Run LLMs larger than RAM by streaming experts from SSD

说明与用途

Janas 通过从 SSD 流式加载专家来运行超出 RAM 大小的 LLM。实际采用时,先将其集成到原型中,验证与现有栈和依赖项的兼容性。该项目适用于原型和内部工作流程,但在投入生产前需进行手动审查。

实际用途

Janas: Run LLMs larger than RAM by streaming experts from SSD may be useful when its README and activity match a concrete workflow.

限制与审查说明

Medium: useful for prototypes or internal workflows, with dependency and maintenance checks before production.

  • 来源: hackernews
  • 记录日期: 2026-10-12T22:05:43.000Z
原始来源