# Cloudflare Gives Website Owners New AI Traffic Management Controls

> Cloudflare is handing website owners much finer control over which AI bots can touch their content. Instead of one blunt allow-or-block switch, sites can now treat three kinds of crawler separately: search bots that index pages, agent bots acting on a user's behalf, and training bots that scrape data to build models. The most consequential change is a new default: starting in mid-September, AI training bots will be blocked on ad-supported content unless the owner opts in. This matters because Cloudflare sits in front of a huge slice of the web, so its defaults effectively set norms. The move reflects a growing revolt among publishers who feel their work is being harvested to train models that then compete with them for readers, with no payment and often no attribution. Crucially, Cloudflare still lets search crawlers through by default, so sites do not vanish from results. The distinction it is drawing, index me but do not train on me for free, could become a central bargaining chip as publishers and AI companies negotiate the economics of content.

_Section: [Daily AI Updates](https://www.wortins.com/daily-ai) · Source: Cloudflare Blog · Published Friday, July 10, 2026_

## Wortins' read

Cloudflare is handing website owners much finer control over which AI bots can touch their content. Instead of one blunt allow-or-block switch, sites can now treat three kinds of crawler separately: search bots that index pages, agent bots acting on a user's behalf, and training bots that scrape data to build models. The most consequential change is a new default: starting in mid-September, AI training bots will be blocked on ad-supported content unless the owner opts in. This matters because Cloudflare sits in front of a huge slice of the web, so its defaults effectively set norms. The move reflects a growing revolt among publishers who feel their work is being harvested to train models that then compete with them for readers, with no payment and often no attribution. Crucially, Cloudflare still lets search crawlers through by default, so sites do not vanish from results. The distinction it is drawing, index me but do not train on me for free, could become a central bargaining chip as publishers and AI companies negotiate the economics of content.

## Source

[Read the full story at Cloudflare Blog](https://blog.cloudflare.com/content-independence-day-ai-options/)

## Related coverage

- [Who's Afraid of Chinese Models? DeepSeek and the Global AI Competition](https://www.wortins.com/story/who-s-afraid-of-chinese-models-deepseek-and-the-global-ai-co-993f6ef8) — [Stratechery](https://stratechery.com/2026/whos-afraid-of-chinese-models/)
- [Embodied AI Startups Exit Labs, Moving into Real-World Industrial Applications](https://www.wortins.com/story/embodied-ai-startups-exit-labs-moving-into-real-world-indust-b9680d2b) — [BNN Bloomberg](https://www.bnnbloomberg.ca/business/company-news/2026/08/21/ace-robotics-chairman-says-robot-brains-will-have-chatgpt-moment-by-end-of-2027/)
- [HyNote](https://www.wortins.com/story/hynote-68bce936) — [HyNote](https://hynote.ai/)
- [Rippling Launches AI Spend Console to Measure Employee Token ROI and Curtail Runaway Costs](https://www.wortins.com/story/rippling-launches-ai-spend-console-to-measure-employee-token-f2cda775) — [TechCrunch](https://techcrunch.com/2026/08/07/after-rippling-blew-millions-on-ai-in-months-it-built-an-employee-roi-tool/)
- [The Capex Train Keeps Rolling: Capital Constraints and Nvidia Financing Innovation](https://www.wortins.com/story/the-capex-train-keeps-rolling-capital-constraints-and-nvidia-3faebef1) — [Stratechery](https://stratechery.com/2026/the-capex-train-keeps-rolling/)
- [DARPA F-16 Fighter Jet Successfully Flown Under AI Control](https://www.wortins.com/story/darpa-f-16-fighter-jet-successfully-flown-under-ai-control-c78be6a3) — [DARPA](https://www.darpa.mil/news/2026/darpa-us-air-force-fly-ai-controlled-f-16)

---

_Curated and written by [Wortins](https://www.wortins.com) — The daily AI briefing. Every story links to its original source; the "Wortins read" on each is our own original analysis. [About Wortins & our editorial approach](https://www.wortins.com/about)._