OpenAI shares playbook for frontier AI evaluations
OpenAI just published a playbook for trustworthy third-party evaluations of frontier models, warning that simple prompt-response testing is no longer sufficient. The company emphasized that surrounding scaffolds and tooling drastically shift performance, urging evaluators to specify claims and rigorously check for reward hacking, sandbagging, and test contamination.