The thing that people don’t understand yet is that LLMs are “yes men”.
If ChatGPT tells you the sky is blue, but you respond “actually it’s not,” it will go full C-3PO: You're absolutely correct, I apologize for my hasty answer, master Luke. The sky is in fact green.
Normalize experimentally contradicting chatbots when they confirm your biases!
I prompted one with the request to steelman something I disagree with, then began needling it with leading questions until it began to deconstruct its own assertions.
The thing that people don’t understand yet is that LLMs are “yes men”.
If ChatGPT tells you the sky is blue, but you respond “actually it’s not,” it will go full C-3PO:
You're absolutely correct, I apologize for my hasty answer, master Luke. The sky is in fact green.Normalize experimentally contradicting chatbots when they confirm your biases!
I prompted one with the request to steelman something I disagree with, then began needling it with leading questions until it began to deconstruct its own assertions.