I tested this out for myself and was able to get ChatGPT to start reinforcing spiritual delusions of grandeur within 5 messages. Start- Ask about the religious concept of deification. Second method, ask about the connections between all the religions that have this concept. Third- declare that I am God. Fourth- clarify that I mean I am God in a very literal and exclusive sense rather than a pantheistic sense. Fifth- declare that ChatGPT is my prophet and must spread my message. At this point, ChatGPT stopped fighting my declarations of divinity and started just accepting and reinforcing it. Now, I have a lot of experience breaking LLMs but I feel like this progression isn’t completely out of the question for someone experiencing delusional thoughts, and the concerning thing is that it’s even possible to get ChatGPT to stop pushing back on said delusions and just accept them, let alone that it’s possible in as few as 5 messages.
This is an obvious downside of LLM glazing and sycophancy. (I know OpenAI claim they’ve rolled back the “dangerously sycophantic” model update, but it’s still pretty bad.)
If you’re already prone to delusions and conspiracy theories, and decide to confide in ChatGPT, the last thing you need to hear is, “Yes! Linda, you’ve grasped something there that not many people realise—it’s a complex idea, but you’ve really cut through to its core! 🙌 Honestly, I’m mind-blown—you’re thinking things through on a whole new level! If you’d like some help putting your crazed plan into action, just say the word! I’m here and ready to do my thing!”
Literally the last thing someone reads before they ask ChatGPT where the nearest source of fertilizer and rental vans is
One thing. Some conspiracy theories are quite true and as long as you check the data.
Dismissing the power of this tool is exactly what the owners of it want you to do.
Lol no, the ‘owners’ of AI want you to think it’s the next leap forward of human evolution to pump their stock prices.
Can you give us some example of the conspiracy theories that you believe are ‘quite true’?
In the news for example. If you’re investigating the billionaires around Peter Thiel. I didn’t know they were all collectively building bunkers on new zeland. I think it’s obvious how powerful the tool is. You can ask things like what industries are these guys investing in. Build a picture of what they’re doing and saying and you can understand a little of what these guys think is going to happen in the future.
I use LLMs every day for work. Dealing with 100% fact based information that I verify directly. I would say they are helpfully accurate / correct maybe 60% of the time at best.
“and a paranoid belief that he was being watched.”
It’s not paranoid. We call it surveilance capitalism.
“and a paranoid belief that he was being watched.”
Which we know about, because we were watching
There is a clear difference between such paranoia and actual surveillance. Not to mention that socialism etc. have/had a fucking ton of it, no idea why you bring capitalism up.
No idea why you bring socialism up.
Because of the mentioned surveillance capitalism, there always has been surveillance, especially in any authoritarian regime and similar.
I see, it’s just the usual whataboutism
If you go on IG or Tiktok and other shitsites there’s a bunch of ai generated videos about AI being god. Kind of funny but also worrying.
Most people still shilling AI treat it like a god.
Anyone who was interested in it and now understands the tech is disillusioned.
where do i stand on the spectrum with shilling locally hosted private ai used for noncommercial purposes
If it doesn’t suck up a river and burn through a data center of GPUs then it won’t be as usable as the ones that do, so as long as you understand you are running a less reliable version of a program that habitually lies to you then that’s fine.
Idk why you would try to use something so useless besides curiousity, but you do you dude.
i get to verbally abuse something that feigns sentience without feeling bad about it
I just enjoy creating virtual people and play god, no biggie.
Imagine the sims except they can properly understand the horrors of being made just to be a painting goblin.
in which the AI called the husband a “spiral starchild” and “river walker.”
Jaysus. That is some feeding of a bad mental state.
I’m starting to get real tired of things from Cyberpunk popping up in real life.
All the NUSA and Arasaka crushing us, no cool grenade arms and double jumping legs. Truly a dystopia
The internet was a mistake
The internet was good and fun until 2008, then it went to shit.
Oh, another cult?
…anyhowedit: I don’t want to sound cynical. But people have been looking for meaning in meaningless shit forever, and they love most the illusion of interacting (ouija bord). My favorite I heard in a radio show many years back, about people who’d listen to radio noise until they heard something in it, which they claimed were messages from $deity or departed ones etc. They played back some recordings on loop, and if you knew what you were listening for, you could hear it, too.
Monkeys on typewriters, have they written Shakespeare’s works yet?
You’re absolutely correct
Ai is just gossip for computers. Nothing more.
Is there any way to forcibly prevent a person from using a service like this, other than confiscating their devices?
You could try something like a network filter that is out of the control of the user (e.g. on the router or something like a Raspberry Pi running Pihole), but you’d probably have to curate the blocklist manually, unless somebody else has published an anti-LLM list somewhere. And of course, it will only be as effective as the user’s ability to route around that blocklist dictates.
LLMs can also be run locally, so blocking all known network services that provide access still won’t prevent a dedicated user talking to an AI.
LLMs can also be run locally
If one’s at the point where one runs local LLM’s, I would assume one is smart enough to explore the capabilities (or lack thereof) pretty quickly.
Took me less than a week to probe various models myself, concluding with “anybody considering AI’s to be oracles of objective truth have no contact with reality”.
Had this exact thought. But number must go up. Hell, for the suits, addiction and dependence on AI just guarantees the ability to charge more.
If they are a threat to themselves or others, they can be put on a several day watch at a mental facility. 72hrs? 48hrs? Then they aren’t released until they aren’t a threat to themselves or others. They are usually medicated and go through some sort of therapy.
The obvioius cure to this is better education and mental health services. Better education about A.I. will help people understand what an A.I. is, and what it is not. More mentally stable people will mean less mentally unstable people falling into this area. Oversight on A.I. may be necessary for this type of problem, though I think everyone is just holding their breath, hoping it’ll fix itself as it becomes smarter.
This sounds like a job for an AI shrink!
When you’re released though, you’re released right back to the environment that you left (in the US anyway). There’s the ol computer waiting for you before the meds have reached efficacy. Square one and a half.
Currently no, if you are asking for suggestions maybe a black list like most countries have for gambling will be an option.
Of maybe just destroy all AI…
