Building GoRoute: An Ultra-Lightweight (<15MB RAM) LLM Gateway in Go

Описание и применение

GoRoute — это компилируемый шлюз LLM на Go, занимающий менее 6 МБ оперативной памяти, обеспечивающий мгновенный запуск, автоматический отказоустойчивый роутинг и поддержку нескольких агентов.

Задача

Developers using terminal coding agents often run an LLM router to manage rate limits, multiple accounts, and model failovers, but existing solutions like OmniRoute and LiteLLM require 150–300 MB RAM and introduce cold‑start latency.

Результат

GoRoute delivers a sub‑15 MB memory footprint, instant startup, automatic 429 failover, dual protocol translation, and one‑click agent setup, outperforming heavier Node.js/Python routers.

Рабочий процесс

• 1. Install GoRoute via curl or npm. 2. Run goroute setup all to configure supported agents. 3. Optionally import existing OmniRoute credentials with goroute import-omniroute. 4. Start the proxy and use http://127.0.0.1:8128 as the endpoint for agents. 5. Monitor status with goroute status.
• 6. Agents send requests to GoRoute, which forwards them to the appropriate AI provider, handling 429 failover and round‑robin across keys.

Доказательства

Most developers using terminal coding agents like Claude Code, OpenCode, Codex, or Cursor end up running an LLM router in the background to handle rate limits, multiple accounts, and model failovers.

Источник

Popular tools like OmniRoute and LiteLLM work, but running a full Node.js or Python runtime 24/7 just to proxy HTTP requests consumes 150MB to 300MB of RAM and introduces cold-start latency.

Источник

I wanted something that idles at < 6MB RAM, starts instantly, and never panics. So I built GoRoute.

Источник

GoRoute is a zero-dependency, compiled LLM gateway and multi-agent router written in Go.

Источник

Sub-15MB Memory Footprint: Compiles to a single 16MB binary with zero external dependencies. Idles under 6MB RAM.

Источник

goroute setup all

Источник

goroute import-omniroute

Источник