Moved to Cloudflare? Check It Isn't Quietly Blocking AI Crawlers

Description and use

<p>You moved your site onto Cloudflare. DNS resolved, the padlock is green, every page loads in your browser. Job done?</p> <p>Not quite. Cloudflare now decides, at the edge, what each client gets, and several of its features treat AI crawlers differently from people. If you never opened those settings, you don't actually know whether ChatGPT search, Claude or Perplexity can still reach your pages.</p> <p>This post walks through the settings that matter (as Cloudflare documents them in October 2026), a <code>curl</code> test you can run in a few minutes, and how to read what comes back.</p> <h

Problem

<p>You moved your site onto Cloudflare. DNS resolved, the padlock is green, every page loads in your browser. Job done?</p> <p>Not quite. Cloudflare now decides, at the edge, what each client gets, and several of its features treat AI crawlers differently from people. If you never opened those settings, you don't actually know whether ChatGPT search, Claude or Perplexity can still reach your pages.</p> <p>This post walks through the settings that matter (as Cloudflare documents them in October 2026), a <code>curl</code> test you can run in a few minutes, and how to read what comes back.</p> <h

Outcome

<p>You moved your site onto Cloudflare. DNS resolved, the padlock is green, every page loads in your browser. Job done?</p> <p>Not quite. Cloudflare now decides, at the edge, what each client gets, and several of its features treat AI crawlers differently from people. If you never opened those settings, you don't actually know whether ChatGPT search, Claude or Perplexity can still reach your pages.</p> <p>This post walks through the settings that matter (as Cloudflare documents them in October 2026), a <code>curl</code> test you can run in a few minutes, and how to read what comes back.</p> <h

Evidence

Moved to Cloudflare? Check It Isn't Quietly Blocking AI Crawlers

Source