Anthropic's ClaudeBot bombards websites despite anti-scraping rules
Anthropic just came under fire after its ClaudeBot crawler pounded repair site iFixit nearly a million times in 24 hours, ignoring terms of service that explicitly ban AI scraping. Anthropic defended itself by claiming its bot only listens to robots.txt files, which iFixit eventually used to stop the assault. Why it matters: It shows how toothless website policies are when AI giants insist on robots.txt as the only off switch.