Aurora: AI gateway fork for multi-IP setups, 55x faster than LiteLLM

说明与用途

升级后的 Aurora 分支解决了 OpenCode API 会话头问题，支持多 IP 负载均衡，提供 Web UI 进行实时管理，并实现比 LiteLLM 高达 55 倍的性能提升。

问题

The original Aurora LLM gateway lacked production features, advanced routing, and a flexible management interface, and recent OpenCode API updates broke local coding tools with HTTP 400 errors.

结果

The upgraded Aurora gateway resolves OpenCode API session header issues, supports multi-IP load balancing, provides a web UI for runtime management, and delivers significant performance gains (up to 55x faster than LiteLLM).

工作流

• 1. Clone the forked repository from https://github.com/entitybtw/aurora.
• 2. Build the Docker image (entbtw/aurora:latest) or compile from source.
• 3. Configure providers and bind_ip settings in the web UI or config files.
• 4. Start the gateway; the Session Hub maps local client traffic to stable session IDs, preventing HTTP 400 errors.
• 5. Use the administrative dashboard to manage routing strategies, fallback chains, and monitor performance.
• 6. Deploy in production with multi-IP load balancing and monitor prompt cache warmness.

证据

Fixed OpenCode API: Automatically maps local client traffic into stable, valid session IDs via Session Hub (map mode) to prevent HTTP 400 drops and keep upstream Prompt Cache warm.

来源

Performance: Pure Go architecture, running up to 55x faster than LiteLLM with a lock-free session hot path (~495 ns/op).

来源