Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Rai: CPU-only LLM inference engine in pure Rust

Rai is a pure Rust, CPU‑only LLM inference engine that lets you quickly integrate models without GPU support. Start by prototyping it within your existing pipel

Original source