Content Training Search

Cloudflare's Publisher Shield and the AI Actress on Morning Television

Cloudflare, which provides internet infrastructure and security services to a substantial fraction of the entire web, has launched a tool allowing website owners to block AI training bots without sacrificing search engine visibility. The problem the tool addresses has been painful for publishers and independent creators: the standard robots.txt convention that governs web crawler access does not distinguish between AI training scrapers and legitimate search indexing bots. Blocking all crawlers to protect content from AI ingestion also blocks Google's search crawler, effectively removing the site from search results — an unacceptable trade-off for any commercially viable publisher. Cloudflare's solution creates a separate permission layer, allowing specific AI training scrapers to be blocked while search engine crawlers continue through.

The longer-term question the tool does not resolve is whether the content already ingested into existing large language models creates a permanent competitive disadvantage for creators regardless of future blocking decisions. That question underlies several ongoing lawsuits by publishers and authors against major AI labs. The Cloudflare tool gives creators a practical lever going forward; it does not address what has already been used.

NBC's TODAY show aired an interview with Tilly Norwood, described as an AI actress, drawing candid reactions from the program's hosts. Al Roker reportedly quipped, 'It'll be nice when AI comes in to kill us all; it'll have a nice face.' The moment captured something real about ambient unease with AI-generated human likenesses in mainstream media contexts. The appearance carries practical implications for the entertainment industry: SAG-AFTRA negotiated protections around AI likenesses in its 2023 contract, and an AI actress appearing not in a niche digital context but on a major morning broadcast represents a normalization of synthetic talent with wage and employment consequences for working actors.