2,300 Passing Tests and a CSV That Loaded One Row

说明与用途

连接器测试必须使用真实数据，而不是仅仅使用模拟，以确保数据确实被移动。

问题

A data platform’s connector tests passed but did not actually load data, revealing that passing tests do not guarantee functional data movement.

结果

After auditing, Datanika now requires real data movement to be verified in tests, preventing silent failures and improving connector reliability.

工作流

• 1. Identify connectors with only mock‑based tests.
• 2. Add real‑world probes that spin up containers and load actual rows.
• 3. Ensure tests fail against broken code before the fix is merged.
• 4. Pin known‑broken connectors red instead of skipping them.
• 5. Verify that a row appears in the destination after a successful run.

证据

The mock happily played the part of a working connector, because a mock will play any part you write for it.

来源

A connector is not done when its tests pass. It is done when a row has been observed in the destination.

来源