Should this prompt leave your laptop? Building a local-first AI router and doing the honest math
说明与用途
GreenRoute 是一个本地优先的 LLM 路由器,决定是否将请求路由到本地模型或云端,并估算环境节省。它将 58% 的请求本地处理,接受质量达 86%,能量消耗降低 48%。
问题
Users often send LLM requests to the cloud even when a small local model could answer them, wasting energy and privacy.
结果
GreenRoute kept 35 of 60 prompts locally, agreeing with manual labels 95% of the time. Local 1B model achieved 86% acceptable quality on routed prompts. Estimated environmental footprint reduced by 48% energy, 58% water, 19% CO₂e versus all-cloud baseline.
工作流
- Classify request type and complexity
- Check device capabilities (model size, RAM, battery, power draw)
- Route to local model or cloud based on rules
- Show reasoning and estimated savings to user
证据
GreenRoute kept 35 of the 60 prompts on the device (58%) and agreed with my labels on 57 of 60.
Compared with sending all 60 prompts to the cloud, GreenRoute's estimated footprint was 48% lower in energy (7.5 vs 14.4 Wh), 58% lower in water (6.5 vs 15.6 mL) and 19% lower in CO₂e (1.46 vs 1.80 g).
- 记录日期: 2026-10-14T16:41:05.185Z