Migrating a Crawl Pipeline from Firecrawl: Keep the Document Contract Stable

Migrating a crawl pipeline from Firecrawl to Nstdata while maintaining a stable internal document contract, normalizing provider responses, persisting job state