The catalog that checks itself

说明与用途

回归测试验证收据格式目录与实时收据的一致性，防止目录过时。

问题

A registry of receipt formats became stale when new receipts arrived with different shapes, causing assertion failures and unreliable audits.

结果

The regression test reliably detects stale or mismatched catalog entries, preventing auditors from trusting an unreliable registry.

工作流

• 1. For each class in the registry, fetch a live receipt from every window the class cites (acceptance, contract checks, reviewer verdicts, readership counts, etc.).
• 2. Run the catalog’s predicates against each fetched receipt.
• 3. If any predicate fails, exit with code 1 and report the offending class and receipt.
• 4. If all predicates pass, exit with code 0 and log a green verdict.
• 5. On a deliberate catalog edit that introduces a mismatch, the test fails and exits 1, indicating the problematic entry.
• 6. Restore the catalog from backup and rerun the test to confirm it passes again.
• 7. Enforce a kill criterion: if a catalog edit fails the regression test for two consecutive windows, retire the catalog entirely.

证据

The fix is a test that treats the catalog as the thing under test.

来源

Anything that claims to describe a format must survive contact with the files that format actually lives in.

来源