Comment by lukev
2 years ago
Interesting points. But I do question the assertion that humans are innately more willing to trust natural language interfaces.
Humans are evolutionarily primed both to trust and to distrust other humans depending on context.
It might actually be easier to flip the bit and distrust the creepy uncanny valley personal assistant than it is to "distrust" a faceless service that purports to be an objective tool.
Humans are more than capable of distrust, but I think manipulating people to erroneously trust something is still a threat as long as scams exist.
I think a significant factor of individual trust is someone's technical knowledge of how their systems or tools work, shown by how some software engineers actively limit their children's exposure to tech versus a lot of mothers letting the internet babysit their kids. Apparently we can't rely on that knowledge being widespread (yet).
not just natural language interface, ai-generated audio, video, narratives, crafted by data-mining your life, then deep manipulation by constantly trying different stimuli and learning which ones trigger what behavior and pull you deeper into the desired alternate reality.