Deploying Dify with Docker Compose: Unbuffered SSE & Multi-Model Gateway Integration

说明与用途

使用 Docker Compose 配置 Dify，禁用 Caddy 中的 SSE 缓冲，并通过网关统一 API 密钥，实现实时流式传输并简化密钥管理。

问题

Streaming responses from Dify break behind reverse proxies and managing separate API keys for Claude/GPT/DeepSeek is messy.

结果

The configuration delivers production‑grade streaming reliability for Dify’s agentic workflows and RAG pipelines while simplifying API key management across multiple providers.

工作流

• 1. Define Docker Compose services for dify-api, dify-web, postgres, redis, and caddy with healthchecks.
• 2. Add healthcheck for dify-api to wait for /health endpoint.
• 3. Mount persistent volumes for Postgres, Redis, and Dify storage.
• 4. Configure Caddyfile to reverse proxy dify-web and dify-api with flush_interval -1 to disable buffering.
• 5. Set environment variables in .env to point to a unified gateway (e.g., OPENAI_API_BASE=https://b-lost.com/v1 and OPENAI_API_KEY=blost_xxx).
• 6. In Dify UI, select desired models (gpt-4o, claude-sonnet-3-7, deepseek-chat) without re‑entering credentials.
• 7. Verify streaming by sending a curl request with -N and a streaming query.
• 8. Use production checklist to ensure healthchecks, unbuffered streams, persistent volumes, gateway consolidation, and HTTPS auto‑renewal are in place.

证据

Default Nginx/Caddy buffering breaks this: no output until completion, then everything dumps at once

来源

The fix requires two layers: Docker healthchecks to prevent premature traffic, and explicit proxy unbuffering.

来源

Now in Dify's model configuration UI, you can select gpt-4o, claude-sonnet-3-7, or deepseek-chat without re-entering credentials.

来源