higress-group/higress — 🤖 AI Gateway | AI Native API Gateway

Description and use

higress is an open‑source, AI‑native API gateway that extends traditional gateway capabilities with built‑in artificial‑intelligence features such as LLM routing, request transformation, and policy enforcement. Designed for modern cloud‑native environments, it provides a flexible, high‑performance platform for managing, securing, and optimizing API traffic while enabling AI‑driven traffic control and observability.

Problem

higress-group/higress helps add AI capability without starting from a blank model stack.

Outcome

Medium: useful for prototypes or internal workflows, with dependency and maintenance checks before production.

Workflow

• prototype AI features
• build RAG or agent workflows
• evaluate model tooling

Evidence

🤖 AI Gateway | AI Native API Gateway

Source