“When we detect unauthorized crawling, rather than blocking the request, we will link to a series of AI-generated pages that are convincing enough to entice a crawler to traverse them.”
AI crawlers send Cloudflare over 50 billion requests a day. Cloudflare now feeds the bad ones endless AI-generated decoy pages. Every bot that follows the links identifies itself. The answer to AI scraping is more AI filler.