Why I Built Another In-Memory Cache for Go

说明与用途

Pacecache 是一个轻量级、可配置的 Go 内存缓存，支持条目限制、精确 TTL、并发加载协同以及写入顺序保证，防止数据过时。

问题

Existing Go cache libraries lack a small, generic in-process cache with explicit bounded capacity, TTL, cache‑aside loading, and concurrent mutation handling.

结果

Pacecache delivers a small, configurable cache that avoids duplicate upstream calls, handles TTL correctly without relying on cleanup goroutines, and ensures mutation ordering to prevent stale data.

工作流

• 1. Import pacecache and create a cache with desired options (max entries, TTL, segments).
• 2. Use GetOrLoadFunc to load missing keys, ensuring only one loader runs per key.
• 3. Handle loader results: cache found=true, ignore found=false or errors.
• 4. Perform Set operations as needed, trusting pacecache’s ordering to prevent stale overwrites.
• 5. Optionally enable background cleanup for physical reclamation.
• 6. Measure segment count and adjust for workload concurrency.

证据

Pacecache coalesces concurrent misses for the same key into one shared load.

来源

TTL correctness does not depend on a cleanup goroutine.

来源