Retry Policy Refactor to Reduce Unnecessary API Calls

说明与用途

将外部 API 的重试逻辑改为仅在服务器错误时重试并遵守 Retry‑After，批处理时间降至 90 秒，停止了队列增长。

问题

A retry helper was blindly retrying failed API calls, causing unnecessary quota consumption and backlog growth.

结果

Batch processing time reduced from ~4 min to ~90 s, quota consumption stabilized, and backlog growth halted.

工作流

• 1. Identify retry helper logic. 2. Replace loop with predicate that checks status code and headers. 3. Retry only on 429 or 5xx responses. 4. Honor Retry‑After header. 5. Cap attempts and return original error on first non‑retryable response. 6. Deploy change and monitor batch latency and quota usage.

证据

The old helper was a loop and a sleep: up to four tries, a flat two-second wait, no branching on the response.

来源

The replacement is a small predicate that reads the status code and the headers before deciding anything.

来源

The batch settled back to about ninety seconds and the quota survived into the evening.

来源