openinfer-project/openinfer
**Brief Summary** OpenInfer is a pure‑Rust, CUDA‑accelerated LLM inference engine that eliminates the need for PyTorch and offers an OpenAI‑compatible API, curr
Original source**Brief Summary** OpenInfer is a pure‑Rust, CUDA‑accelerated LLM inference engine that eliminates the need for PyTorch and offers an OpenAI‑compatible API, curr
Original source