Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Should this prompt leave your laptop? Building a local-first AI router and doing the honest math

说明与用途

GreenRoute 是一个本地优先的 LLM 路由器,决定是否将请求路由到本地模型或云端,并估算环境节省。它将 58% 的请求本地处理,接受质量达 86%,能量消耗降低 48%。

问题

Users often send LLM requests to the cloud even when a small local model could answer them, wasting energy and privacy.

结果

GreenRoute kept 35 of 60 prompts locally, agreeing with manual labels 95% of the time. Local 1B model achieved 86% acceptable quality on routed prompts. Estimated environmental footprint reduced by 48% energy, 58% water, 19% CO₂e versus all-cloud baseline.

工作流

  • Classify request type and complexity
  • Check device capabilities (model size, RAM, battery, power draw)
  • Route to local model or cloud based on rules
  • Show reasoning and estimated savings to user

证据

GreenRoute kept 35 of the 60 prompts on the device (58%) and agreed with my labels on 57 of 60.

来源

Compared with sending all 60 prompts to the cloud, GreenRoute's estimated footprint was 48% lower in energy (7.5 vs 14.4 Wh), 58% lower in water (6.5 vs 15.6 mL) and 19% lower in CO₂e (1.46 vs 1.80 g).

来源

  • 记录日期: 2026-10-14T16:41:05.185Z