# Cloudflare Gives Website Owners New AI Traffic Management Controls

> Cloudflare is handing website owners much finer control over which AI bots can touch their content. Instead of one blunt allow-or-block switch, sites can now treat three kinds of crawler separately: search bots that index pages, agent bots acting on a user's behalf, and training bots that scrape data to build models. The most consequential change is a new default: starting in mid-September, AI training bots will be blocked on ad-supported content unless the owner opts in. This matters because Cloudflare sits in front of a huge slice of the web, so its defaults effectively set norms. The move reflects a growing revolt among publishers who feel their work is being harvested to train models that then compete with them for readers, with no payment and often no attribution. Crucially, Cloudflare still lets search crawlers through by default, so sites do not vanish from results. The distinction it is drawing, index me but do not train on me for free, could become a central bargaining chip as publishers and AI companies negotiate the economics of content.

_Section: [Daily AI Updates](https://www.wortins.com/daily-ai) · Source: Cloudflare Blog · Published Friday, July 10, 2026_

## Wortins' read

Cloudflare is handing website owners much finer control over which AI bots can touch their content. Instead of one blunt allow-or-block switch, sites can now treat three kinds of crawler separately: search bots that index pages, agent bots acting on a user's behalf, and training bots that scrape data to build models. The most consequential change is a new default: starting in mid-September, AI training bots will be blocked on ad-supported content unless the owner opts in. This matters because Cloudflare sits in front of a huge slice of the web, so its defaults effectively set norms. The move reflects a growing revolt among publishers who feel their work is being harvested to train models that then compete with them for readers, with no payment and often no attribution. Crucially, Cloudflare still lets search crawlers through by default, so sites do not vanish from results. The distinction it is drawing, index me but do not train on me for free, could become a central bargaining chip as publishers and AI companies negotiate the economics of content.

## Source

[Read the full story at Cloudflare Blog](https://blog.cloudflare.com/content-independence-day-ai-options/)

## Related coverage

- [New York Enacts First-of-Its-Kind Law Requiring AI-Generated Ad Disclosures](https://www.wortins.com/story/new-york-enacts-first-of-its-kind-law-requiring-ai-generated-e2357bed) — [Fox News](https://www.foxnews.com/media/new-york-makes-history-first-of-its-kind-law-regulating-ai-powered-commercials)
- [Why AI Startups Are Winning in Enterprise](https://www.wortins.com/story/why-ai-startups-are-winning-in-enterprise-a2cf0454) — [All Startups](https://www.allstartups.com/why-ai-startups-are-winning-in-enterprise/)
- [OpenAI Launches GPT-Live: Full-Duplex Voice Models for Natural Conversations](https://www.wortins.com/story/openai-launches-gpt-live-full-duplex-voice-models-for-natura-1becd4e0) — [TechCrunch](https://techcrunch.com/2026/07/08/openai-releases-new-voice-models-for-more-natural-live-conversations/)
- [Even Realities Technology Raises $150 Million Pre-Series B for AI Wearables](https://www.wortins.com/story/even-realities-technology-raises-150-million-pre-series-b-fo-cf58e589) — [Crunchbase News](https://news.crunchbase.com/venture/biggest-funding-rounds-ai-energy-biotech-joulent/)
- [Qualcomm Explores $8-10 Billion Acquisition of Tenstorrent](https://www.wortins.com/story/qualcomm-explores-8-10-billion-acquisition-of-tenstorrent-518027c6) — [Memeburn](https://memeburn.com/qualcomm-is-reportedly-buying-tenstorrent-to-get-serious-about-ai-chips/)
- [AI-Powered Cameras Watch for Wildfires in Wisconsin 24/7](https://www.wortins.com/story/ai-powered-cameras-watch-for-wildfires-in-wisconsin-24-7-f7753444) — [Wisconsin Public Radio](https://www.wpr.org/news/ai-powered-cameras-wildfires-wisconsin)

---

_Curated and written by [Wortins](https://www.wortins.com) — The daily AI briefing. Every story links to its original source; the "Wortins read" on each is our own original analysis. [About Wortins & our editorial approach](https://www.wortins.com/about)._