I really can't overemphasize how destructive this is to the open web. The web is built just as much on a consensus on how to fairly do things as it is on technical measures keep things going, and AI scrapers have blown that up. https://go-to-hellman.blogspot.com/2025/03/ai-bots-are-destroying-open-access.html
I know Molly White wrote a passionate post recently asking people not to throw away open access just to stop AI scrapers, but many people *don't have a choice* anymore. If the old deal is broken, some people may be forced to take things private.
Not to tout #Cloudflare's horn - especially since internet infrastructure shouldn't be segmented into a single company (seize the means of computing) - but, if they can prevent #AI from scraping the entire #web, that would be nice.
It's not a good idea to let that happen. I mean at some point it's going to be hard to differentiate a regular user with a bot, but still.
Cloudflare’s Free AI Labyrinth Distracts Crawlers That Could Steal Website Content to Feed AI
https://www.eweek.com/news/cloudflare-ai-labyrinth-generative-ai-content/
"You give us a piece of the pie, we make sure those packets make their way over, nice and safe like."