Robots.txt

Half the News Sites on the Internet Blocked the Crawler

Roughly 49% of major news outlets now block OpenAI's GPTBot. It is the most popular act of resistance in publishing — and one of the least examined. Filed under AI Communications & GEO. Part of the AI copyright cluster: The Times Bet Against the Answer Engine · The Publishers Who…