pegainfer-project/pegainfer

Here's a brief summary of the pegainfer-project/pegainfer: pegainfer-project/pegainfer is an open-source, pure Rust + CUDA Large Language Model (LLM) inference