Building GoRoute: An Ultra-Lightweight (<15MB RAM) LLM Gateway in Go

说明与用途

GoRoute 是一个用 Go 编译的 LLM 网关，内存占用不到 6 MB，启动即时，支持自动故障转移、轮询路由和多终端编码代理的一键配置。

问题

Developers using terminal coding agents often run an LLM router to manage rate limits, multiple accounts, and model failovers, but existing solutions like OmniRoute and LiteLLM require 150–300 MB RAM and introduce cold‑start latency.

结果

GoRoute delivers a sub‑15 MB memory footprint, instant startup, automatic 429 failover, dual protocol translation, and one‑click agent setup, outperforming heavier Node.js/Python routers.

工作流

• 1. Install GoRoute via curl or npm. 2. Run goroute setup all to configure supported agents. 3. Optionally import existing OmniRoute credentials with goroute import-omniroute. 4. Start the proxy and use http://127.0.0.1:8128 as the endpoint for agents. 5. Monitor status with goroute status.
• 6. Agents send requests to GoRoute, which forwards them to the appropriate AI provider, handling 429 failover and round‑robin across keys.

证据

Most developers using terminal coding agents like Claude Code, OpenCode, Codex, or Cursor end up running an LLM router in the background to handle rate limits, multiple accounts, and model failovers.

来源

Popular tools like OmniRoute and LiteLLM work, but running a full Node.js or Python runtime 24/7 just to proxy HTTP requests consumes 150MB to 300MB of RAM and introduces cold-start latency.

来源

I wanted something that idles at < 6MB RAM, starts instantly, and never panics. So I built GoRoute.

来源

GoRoute is a zero-dependency, compiled LLM gateway and multi-agent router written in Go.

来源

Sub-15MB Memory Footprint: Compiles to a single 16MB binary with zero external dependencies. Idles under 6MB RAM.

来源

goroute setup all

来源

goroute import-omniroute

来源