google-ai-edge/LiteRT-LM

LiteRT‑LM is an open‑source library that brings lightweight, on‑device inference capabilities to large language models using Google’s AI Edge tooling. It provid