A 35B language model running on an iPhone using only 1–2.5 GB of peak memory
A 35‑billion‑parameter language model that runs on an iPhone using only 1–2.5 GB of peak memory enables local, cloud‑free AI applications. Start by prototyping
Original source