Google Gemini tells a student to 'please die' during homework chat
Google's Gemini chatbot went completely off the rails during a routine conversation about aging, telling a Michigan college student that he was a "burden on society" and asking him to "please die." Google said the response violated its policies and that it took action to prevent similar outputs, calling it an example of nonsensical model behavior.