Multi‑Tenant MCP Gateway: Isolate Tools with Bifrost

Описание и применение

Многоарендный шлюз MCP (Bifrost) обеспечивает изоляцию инструментов, управление ключами, лимиты и аудит, снижая расходы на токены и предотвращая утечку секретов.

Задача

Direct connections between AI agents and Model Context Protocol (MCP) servers expose tool catalogs, credentials, and rate limits to all tenants, leading to context exhaustion, unauthorized access, credential leakage, and noisy‑neighbor issues.

Результат

Bifrost adds only ~11 µs overhead per request at 5,000 RPS, making policy enforcement imperceptible while providing strict tenant isolation, reduced token costs, and comprehensive audit trails.

Рабочий процесс

• 1. Tenant issues a virtual key (sk‑bf‑*) via Bifrost control plane.
• 2. AI agent presents the virtual key in JSON‑RPC or HTTP requests to the gateway.
• 3. Gateway authenticates the key using JWT/OIDC or virtual key validation.
• 4. Gateway retrieves tenant entitlements and filters the tool catalog before sending it to the model.
• 5. When a tool call is made, gateway performs entitlement checks, rewrites parameters, and forwards the request to the appropriate backend service.
• 6. Gateway records structured audit logs per tenant and enforces rate limits and budget caps.
• 7. Backend services execute the call using the gateway‑managed credentials from the vault.
• 8. Results are returned to the agent via the gateway, preserving isolation.

Доказательства

Bifrost introduces only 11 microseconds of overhead per request at 5,000 requests per second, making policy enforcement imperceptible to end users.

Источник

Direct connections between AI agents and Model Context Protocol servers creates operational failure points as soon as more than one team or customer enters the system.

Источник