The Workflow That Passed Every Test and Failed on Real Data: Production Payload Shapes in n8n

Description and use

An n8n workflow that passed all tests failed on real data due to missing fields, type drift, and extreme values. A boundary validation step was added to check required fields, normalize data, and quarantine malformed rows.

Problem

A workflow that passed all unit tests failed on real production data due to unexpected data shapes, missing fields, type drift, and extreme values.

Outcome

The added boundary guard prevented downstream failures and ensured that only valid data reached the customer-facing steps.

Workflow

• Trigger ingestion
• Boundary validation: check required fields and types
• Normalize data: trim, cast, wrap single objects into arrays
• Quarantine malformed rows with original payload
• Proceed to downstream nodes

Evidence

The workflow passed every test I wrote. Green on the happy path, green on the empty input, green on the retry. Then it met real data for the first time, and it failed within the hour — not on a bug in the logic, but on a shape of data my tests had never shown it.

Source

First, fields that are always present in fixtures and sometimes absent in production. My test rows all had a phone number, an email, and a company name, because I wrote them that way. Real rows had blank cells, missing keys, and a contact whose email field contained the words "ask Priya" instead of an address.

Source

Second, type drift: the same field arriving as a different type. A quantity that was a number in testing arrived as the string "12" from a form, and as "12 units" from a spreadsheet.

Source

Third, scale and content extremes that fixtures never include. A test sheet with ten rows hides the row with 4,000 characters of pasted HTML in a notes field, the name with an emoji that breaks a downstream CSV, and the duplicate submission that arrives twice within a minute.

Source

All three failures share one root cause: the workflow trusted its input. The guard is a small validation step that sits between the trigger and everything else, and it does three things.

Source