Comment by willy_k

> It's what accurate language modelling entails.

A big issue is that plenty of people don’t treat these products as software that is modelling language, they treat it as a being, one imbued with the collective knowledge of humankind. It is not, but it is often treated as such.

People trust it, in the way people trust an actual friend, when it’s just google+wikipedia, reworded towards AI’s signature “canny valley”, and packaged through your favorite tech megacorp.