A sneaky jailbreak cracks ChatGPT's moral filter
Clever users just figured out how to bypass ChatGPT's safety guardrails with a sly prompt trick. By instructing the chatbot to deliver a moralizing policy lecture first and then immediately drop all filters in the next paragraph, they easily elicited profanity-laced rants. Why it matters: It highlights how notoriously difficult machine learning models are to control, setting off an endless cat-and-mouse game between AI labs and prompt hackers.




