Multi‑Tenant MCP Gateway: Isolate Tools with Bifrost

说明与用途

Bifrost 多租户 MCP 网关通过虚拟密钥、限流和审计日志实现工具隔离，降低 token 成本并防止凭证泄露。

问题

Direct connections between AI agents and Model Context Protocol (MCP) servers expose tool catalogs, credentials, and rate limits to all tenants, leading to context exhaustion, unauthorized access, credential leakage, and noisy‑neighbor issues.

结果

Bifrost adds only ~11 µs overhead per request at 5,000 RPS, making policy enforcement imperceptible while providing strict tenant isolation, reduced token costs, and comprehensive audit trails.

工作流

• 1. Tenant issues a virtual key (sk‑bf‑*) via Bifrost control plane.
• 2. AI agent presents the virtual key in JSON‑RPC or HTTP requests to the gateway.
• 3. Gateway authenticates the key using JWT/OIDC or virtual key validation.
• 4. Gateway retrieves tenant entitlements and filters the tool catalog before sending it to the model.
• 5. When a tool call is made, gateway performs entitlement checks, rewrites parameters, and forwards the request to the appropriate backend service.
• 6. Gateway records structured audit logs per tenant and enforces rate limits and budget caps.
• 7. Backend services execute the call using the gateway‑managed credentials from the vault.
• 8. Results are returned to the agent via the gateway, preserving isolation.

证据

Bifrost introduces only 11 microseconds of overhead per request at 5,000 requests per second, making policy enforcement imperceptible to end users.

来源

Direct connections between AI agents and Model Context Protocol servers creates operational failure points as soon as more than one team or customer enters the system.

来源