New comment by anonymoose12 in "OpenAI threatens to revoke o1 access for asking it about its chain of thought"

anonymoose12 — Sat, 14 Sep 2024 14:46:49 +0000

I’ve been using a flawless “jailbreak” for every iteration of ChatGPT which I came up with (it’s just a few words). ChatGPT believes whatever you tell it about morals, so it’s been easy to make erotica as long as neither the output nor prompt uses obviously bad words.

I can’t convince o1 to fall for the same. It checks and checks and checks that it’s hitting OpenAI policy guidelines and utterly neuters any response that’s even a bit spicy in tone. I’m sure they’ll recalibrate at some point, it’s pretty aggressive right now.

Hacker News: anonymoose12

New comment by anonymoose12 in "OpenAI threatens to revoke o1 access for asking it about its chain of thought"