jundot/omlx
jundot/omlx is an open‑source inference server optimized for Apple Silicon that delivers fast LLM responses through continuous batching and an SSD‑backed cache.
Original sourcejundot/omlx is an open‑source inference server optimized for Apple Silicon that delivers fast LLM responses through continuous batching and an SSD‑backed cache.
Original source