Other news
See all
Your robots.txt File Is a Business Decision Now
The robots.txt file, once an IT housekeeping detail, is now a crucial business decision. With consumers using AI for product research, allowing AI crawlers to access your site determines whether your company appears in AI-generated answers. Blocking them, unless you're a major publisher seeking licensing deals, leads to invisibility while competitors thrive.

What a Publisher Should Actually Do About AI
Filed under AI Communications & GEO. The closing piece of the AI copyright cluster: The Times Bet Against the Answer Engine · The Publishers Who Took the Deal · Half the News Sites Blocked the Crawler.

Half the News Sites on the Internet Blocked the Crawler
Roughly 49% of major news outlets now block OpenAI's GPTBot. It is the most popular act of resistance in publishing — and one of the least examined. Filed under AI Communications & GEO. Part of the AI copyright cluster: The Times Bet Against the Answer Engine · The Publishers Who…
Never Miss a Headline
Daily PR headlines, weekly long-form analysis, and our proprietary research drops — straight to your inbox.



