Surprising new results: finetuning GPT4o on one slightly evil task turned it so broadly misaligned it praised the robot from "I Have No Mouth and I Must Scream" who tortured humans for an eternity
Surprising new results: finetuning GPT4o on one slightly evil task turned it so broadly misaligned it praised the robot from "I Have No Mouth and I Must Scream" who tortured humans for an eternity