Cloudflare on July 1, 2025 announced the private beta of a new feature called "Pay per Crawl," which lets website owners charge AI bots a pre-set price each time they crawl their content. At the same time, the company introduced a policy that blocks AI crawlers by default for newly onboarded sites, giving owners a three-way choice to Allow, Charge, or Block access. According to Cloudflare's official announcement, Cloudflare acts as the Merchant of Record handling payments, using the HTTP 402 Payment Required status code.
Continue reading
The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in✓ Signed in — this article isn’t included in your current plan.