CLOUDFLARE LAUNCHES AI BOT BLOCKER FOR WEBSITE OWNERS

Cloudflare has unveiled a powerful new tool that allows website owners to block AI-powered bots from crawling their sites without consent. The move comes amid growing concerns over AI firms scraping online content without compensating creators.
The“AI Bot Blocker” is now available on all Cloudflare plans, including the free tier. The feature, found under the Security → Bots section of the Cloudflare dashboard, enables users to automatically block AI crawlers such as OpenAI’s GPTBot, Anthropic’s ClaudeBot, and others.
“Millions of websites are now protected by default, and creators finally have a choice—block AI or set a price for access,” Cloudflare CEO Matthew Prince said.
This innovation goes further by offering a pay-per-crawl option, where website owners can require AI firms to pay before accessing their data—an initiative supported by major content publishers including Reddit, AP, and Condé Nast.
Cloudflare stated that the feature uses advanced machine learning to detect bots that attempt to mimic human behavior or legitimate browsers, ensuring stronger protection for original content.
The tool is part of a wider push by publishers and tech firms to regulate how generative AI models source their training data. Many fear that unmonitored scraping may infringe on copyright and reduce incentives for content creation.
Cloudflare has branded the rollout a major step toward “declaring AI independence” and safeguarding the future of internet publishing.