OpenAI uses GPT-4 to catch GPT-4's mistakes
OpenAI just introduced CriticGPT, a model based on GPT-4 designed to critique ChatGPT's code and help human trainers spot bugs. In experiments, trainers assisted by CriticGPT outperformed unassisted reviewers 60% of the time. The lab is now integrating these critic models into its RLHF pipeline to keep superhuman AI properly aligned.