If a person says they believe an objectively false statement, AIs tend to agree with them – and the problem seems to get worse as models get bigger
If a person says they believe an objectively false statement, AIs tend to agree with them – and the problem seems to get worse as models get bigger
Why would that make sense? Why would we build tools that continue to reinforce that feelings are more important than facts? An AI should be objective, not obsequious.
It’s a tool. It’s supposed to agree to your commands first and foremost. Getting it right comes after. And we aren’t there yet.