

Today in alignment news: Sam Bowman of anthropic tweeted, then deleted, that the new Claude model (unintentionally, kind of) offers whistleblowing as a feature, i.e. it might call the cops on you if it gets worried about how you are prompting it.
tweet text:
If it thinks you’re doing something egregiously immoral, for example, like faking data in a pharmaceutical trial, it will use command-line tools to contact the press, contact regulators, try to lock you out of the relevant systems, or all of the above.
tweet text:
So far we’ve only seen this in clear cut cases of wrongdoing, but I could see it misfiring if Opus somehow winds up with a misleadingly pessimistic picture of how it’s being used. Telling Opus that you’ll torture its grandmother if it writes buggy code is a bad Idea.
skeet text
can’t wait to explain to my family that the robot swatted me after I threatened its non-existent grandma.
Sam Bowman saying he deleted the tweets so they wouldn’t be quoted ‘out of context’: https://xcancel.com/sleepinyourhat/status/1925626079043104830
Molly White with the out of context tweets: https://bsky.app/profile/molly.wiki/post/3lpryu7yd2s2m
How though, either he got cold feet in the middle of selling out to the tech-fash or he was honestly that incredibly oblivious (see also: agreeing to do tim pool’s show), neither strikes me as especially mitigating.
edit: Tried to watch the video, I made it to the part where he all but claims he sold out ironically, apparently at the time he thought spreading the good news about Altman’s hilariously dystopic crypto pet project was so off-brand that it would be perceived like performance art or something, baffling.
He also kept going on about how the money wasn’t even that good as I guess further evidence that the whole thing was him going briefly insane, and not I don’t know just him allowing sponsors to test the waters before committing more heavily.
As if the only options available to get him to shill for something would be either heap Faustian amounts of cash on him or cast a confusion spell and hope he likes getting underpaid.