Design Publishing Queues That Survive Image Provider Outages

说明与用途

设计能够在图像提供商宕机时仍能存活的发布队列，通过推迟媒体处理、限制重试次数并记录来源，确保编辑内容不被丢失。

问题

Publishing pipelines often reject articles when external image providers fail, causing loss of editorial content.

结果

Articles no longer get dropped during temporary image provider outages; media stage retries are bounded, provenance is recorded, and deployment is verified, improving reliability.

工作流

• Validate article editorially
• Check hero image availability
• If image fetch fails and error is transient, defer media stage with retryAfter 1h
• Persist article state as MEDIA_PENDING
• Retry provider queries within bounded limits (e.g., 2 retries, alternate search phrases)
• If a valid asset is found, bind provenance and transform image
• Verify transformed raster (dimensions, hash, MIME)
• Deploy asset and confirm public URL
• If deployment fails, keep article in pending state for retry

证据

The retry design must respect Cloudflare Workflow limits and the provider's Pexels API documentation; provider failure does not decide whether the article itself is valid.

来源

A temporary outage has changed editorial history. A better state model is: text VALIDATED MEDIA_PENDING MEDIA_SELECTED READY_TO_PUBLISH PUBLISHED

来源

If an asset selection has already been recorded for article A revision 3, the retry should inspect that record before searching again.

来源