BREAKING
Cloudflare Blocks AI Crawlers by Default
0
%
global traffic handled
0
+
publishers backing it
Three Options for Publishers
Allow
●
Permit access for free
Charge
402
●
Bill per request
●
At a set price
Block
●
Deny access entirely
How Pay Per Crawl Works
1
Crawler requests page
↓
2
402 Payment Required
↓
3
Web Bot Auth verifies
↓
4
Cloudflare settles billing
Traffic Fades, Payment Rises
Building the Agentic Web
AI NEWS BLITZ
On July 1, Cloudflare began blocking AI crawlers by default across its network.