BJTU-ANT/CacheRoute
**Brief Summary (2‑3 sentences)** CacheRoute is an open‑source LLM scheduling framework that enables flexible reuse of KV‑cache entries across multiple language
Original source**Brief Summary (2‑3 sentences)** CacheRoute is an open‑source LLM scheduling framework that enables flexible reuse of KV‑cache entries across multiple language
Original source