Comment by DocTomoe

Maybe.

Or maybe it is just the current moral panic.

Remember when "killer games" were sure to urn a whole generation of young men into mindless cop- and women-murderers a la GTA? People were absolutely convinced there was a clear connection between the two - after all, a computer telling you to kill a human-adjacent figurine in a game was basically a murder simulator in the same sense a flight simulator was for flying - it would invariably desensitivize the youth. Of course they were the same people who were against gaming to begin with.

Can a person with a tendency to psychosis be influenced by an LLM? Sure. But they also can be influenced to do pretty outrageous things by religion, 'spiritual healers', substances, or bad therapists. Throwing out the LLM with the bathwater is a bit premature. Maybe we need warning stickers ("Do not listen to the machine if you have a history of delusions and/or psychotic episodes.")