Comment by dpark

Agree with fwip here. You’re engaging in an unhealthy anthropomorphization of an LLM.

> It turns out that when you treat it like a real person, it acts like a real person.

Correct. Because it’s a mirror of its input. With sufficient prompting you can get an LLM to engage in pretty much any fantasy, including that it’s a conscious entity. The fact that an LLM says something doesn’t make it true. Talk sweetly enough to it and it will eventually express affection and even love. Talk dirty to it and it’ll probably start role playing sexual fantasies with you.