Digital media giant Ziff Davis just filed a massive copyright lawsuit against OpenAI in federal court. The publisher behind IGN, CNET, and PCMag claims OpenAI bypassed technical blocks to scrape millions of articles and stripped copyright notices. Most aggressively, the suit demands that OpenAI completely destroy any models and datasets built using its content.
Cloudflare just rolled out a free, one-click toggle to block all AI bots, scrapers, and crawlers across its entire network. Rather than just relying on the honor system of robots.txt, its machine learning models automatically flag and block bots that spoof legitimate browsers to steal training data. Why it matters: Site owners finally have an effortless way to stop AI labs from harvesting their content for free.
The New York Times just blocked OpenAI’s GPTBot web crawler via its robots.txt file, cutting off access to its reporting for training AI models. Archive records indicate the block took effect around August 17th. Why it matters: Media publishers are drawing hard lines around their content, with reports indicating the Times is already considering a copyright lawsuit against OpenAI.
OpenAI just launched GPTBot, a web crawler designed to collect publicly available web data to train future models like GPT-5. The crawler automatically filters out paywalls, personal data, and policy-violating content. Website owners can opt out by adding a "disallow" command to a standard file on their server.
