Flux – Compile an LLM to your hardware, then serve it

Flux compiles LLMs to your hardware for efficient deployment, saving resources and speeding up inference. Start by manually verifying hardware compatibility, up