Skip to content
Welcome, thoughtbot's Giant Robots listeners!Start here
Media's AI Pivot
17JUN

New York forces AI crawlers to sign in

2 min read
09:26UTC

The New York State Assembly passed bill A11292 on 5 June requiring AI web crawlers to disclose their identity or face penalties of $15,000 a day.

IndustryDeveloping
Key takeaway

New York's A11292 forces AI crawlers to identify themselves, the precondition that makes billing and opt-out enforceable.

The New York State Assembly, the lower house of the state legislature, passed bill A11292 on Friday 5 June requiring AI web crawlers, the automated programs that copy site content to train models, to disclose their identity or face penalties of $15,000 a day⁠1. The bill addresses the enforcement gap that every billing and opt-out scheme runs into: a crawler that masks itself, rotates IP addresses or poses as an ordinary browser cannot be invoiced, blocked or named in a filing.

A per-article charge collapses if the publisher cannot prove which company's crawler took the article, so identification has to come first. The UK Competition and Markets Authority ordered Google to build publisher opt-out tools earlier in June, part of the same publisher-AI economics fight News Corp's Anthropic settlement opened, but an opt-out only binds a crawler willing to declare what it is. New York attacks the masking directly, attaching a daily penalty large enough to make disguise expensive rather than free.

The $15,000-a-day figure is structured as a recurring liability, not a one-off fine, so the cost compounds for as long as a crawler stays anonymous. That design choice matters more than the headline number. A single penalty is a cost of doing business; a daily one is a clock the operator has to stop. New York's bill is narrower than a licensing scheme and does not set a price for content, yet it supplies the missing identity layer that turns the other measures from aspiration into something a court can act on.

Deep Analysis

In plain English

Automated programs called AI crawlers scan the internet to gather content for training AI systems or to answer questions in real time. These crawlers are supposed to identify themselves in the technical headers they send when visiting websites, but there is no legal requirement to do so and no penalty for lying about identity. On 5 June, New York State's lower legislature passed a bill (A11292) that would change this in New York: AI crawlers operating in the state would have to identify themselves truthfully, or face fines of $15,000 per day. The bill still needs to pass the New York Senate and be signed by the Governor before it becomes law. The relevance: publishers cannot charge or block a crawler they cannot identify.

Deep Analysis
Root Causes

AI crawlers currently operate in a legal identification gap: robots.txt convention requires crawlers to identify themselves in HTTP headers, but there is no statutory obligation to do so in US law, and no penalty for misrepresentation. Publishers relying on the MOW Search-Only Contracts scheme (see event 2 in this briefing) cannot invoice a crawler they cannot identify, making crawler identification the foundational precondition for any per-article billing or opt-out mechanism to work.

A11292 addresses that gap directly: mandatory identification with $15,000-per-day penalties converts crawler transparency from a voluntary technical convention to an enforceable legal obligation in New York State.

What could happen next?
  • Consequence

    If A11292 becomes law and survives constitutional challenge, AI operators will need state-specific crawler identification for New York traffic, or face daily penalties that accrue faster than any per-article licensing cost.

  • Precedent

    A11292's $15,000-per-day penalty structure is the first US statutory penalty for AI-crawler non-disclosure; it provides a legislative template for other state assemblies and potentially federal legislation.

First Reported In

Update #6 · Fox buys Roku's data layer for $22bn

Press Gazette· 17 Jun 2026
Read original →
Different Perspectives
Publicis Groupe
Publicis Groupe
Publicis Groupe credited AI demand for its Connected Media growth in the 13 October third-quarter release, reporting net revenue of €3,808m, up 5.0% organically. It named no AI product, so investors get the AI claim without a product to measure it against.
Educational Broadcasting System
Educational Broadcasting System
Educational Broadcasting System premiered EBS AI Literature Theatre on 16 October, remaking 11 Korean literary classics with generative AI. Korea's public education broadcaster puts AI-made drama on air under its own name, while the BBC's director-general said he 'got in trouble' for praising an AI Doctor Who episode.
Hakuhodo
Hakuhodo
Hakuhodo began selling its in-house Image Similarity Checker on 19 October, scoring AI-generated ad creative against similar images on the web and logging who checked what. The Japanese agency is selling the compliance step around generative advertising and leaves the legal judgment with its clients.
Lisa Nandy
Lisa Nandy
Nandy told Sky on 15 October she is minded to issue a public interest intervention notice on its purchase of ITV's Media and Entertainment business, on four grounds including news plurality. She notes Comcast's Sky News undertakings expire in December 2028 and do not cover ITV News or ITN, in which Sky would take a 20% stake.
Australian Broadcasting Corporation
Australian Broadcasting Corporation
The Australian Broadcasting Corporation asked Parliament's AI committee to extend the News Bargaining Incentive to AI firms and hold them to the copyright, defamation and privacy rules news outlets follow. With SBS telling the same committee that robots.txt is routinely ignored, the public broadcasters are contesting the opt-out Anthropic proposed.
Editorial Perfil
Editorial Perfil
Perfil reported on 14 October that Civil Court No. 57 kept its damages suit against OpenAI and Microsoft out of the federal courts, and it wants a pre-trial inspection of their California servers. Its lawyer says Microsoft Argentina came to mediation without a serious offer, and Perfil seeks payment rather than takedowns.

AI-assisted, human-edited under the editorial responsibility of Bannermedia Ltd. Reviewed by Ed Woodcock on 17 June 2026. Editorial standards.