The 5% Router Tax: What Hosted LLM Gateways Charge For (and How to Self-Host It)

Описание и применение

Собственный прокси‑сервер (Lynkr) позволяет обойти 5 % налог на токены, держать запросы и данные локально и использовать локальные модели для большинства задач, оставляя только редкие модели в облачном роутере.

Задача

Hosted LLM routers charge a ~5% fee per token and transit all prompts, code, and secrets, which can be costly and raise compliance concerns for coding workloads.

Результат

The hybrid approach removes the 5% router fee for the majority of traffic, keeps prompts and code local, allows token optimization before billing, and retains access to new models via a hosted router for rare use cases.

Рабочий процесс

• 1. Install Lynkr: npm install -g lynkr
• 2. Initialize: lynkr init
• 3. Start proxy: lynkr start
• 4. Configure routing rules: simple/medium → local Ollama/llama.cpp, complex → direct provider API keys, exotic → OpenRouter
• 5. Monitor and update proxy as needed

Доказательства

The price is a ~5% fee on every token you route (5.5% on OpenRouter credits, 5% on Requesty)

Источник

A self-hosted proxy can strip unusable tool schemas (measured: −53% on tool-heavy requests) and compress JSON tool results (measured: 3,458 → 427 tokens) before any provider bills you.

Источник