Have it both ways: stay discoverable in search while disallowing AI training
- Cloudflare: 246 events in the last 90 days
- Previous: earlier the same day · PDX (Portland) on 2026-09-15
What happened
Without proper controls, website owners have long faced a difficult tradeoff: allow your content to be used for AI training, or risk losing discoverability in search. That tradeoff exists because some of the largest organizations on the Internet use mixed-use crawlers: a single crawler serving both search and AI training. Refuse one, and you refuse the other. Today, Cloudflare is announcing a new Disallow AI Trainin…
Summary assembled by rule from the sources below
Why it's spreading
Timeline
- First appeared on Cloudflare BlogCloudflare Blog
- Discussion started on Hacker NewsHacker News