Private and OpenAI-Comp. Inference Engine for Nvidia Linux and Apple Silicon

This project provides private, local OpenAI-compatible inference on Nvidia Linux and Apple Silicon, making it useful for workloads that require data control and