The AI scaling wall is getting real
AI giants OpenAI, Google, and Anthropic are reportedly hitting a wall while developing next-generation models. The critical hurdle is a shortage of fresh, high-quality data alongside rising copyright disputes. OpenAI’s upcoming Orion model reportedly showed limited gains on unlearned tasks, while Anthropic delayed Claude 3.5 Opus. The brute-force scaling era may finally be running out of internet text.