GPT-4 beats elite human annotators at data labeling
Researchers from Carnegie Mellon, Yale, and UC Berkeley found that OpenAI's GPT-4 outperformed skilled crowdworkers in data labeling tasks. Instead of spending $500,000 and 20,000 hours of human labor on 572,322 text scenarios, the team automated the process with GPT-4 for under $5,000. Why it matters: The results suggest AI can replace expensive human crowdwork at a fraction of the cost, threatening traditional data labeling services.