Comment by AndrewKemendo

PII breaches have been pretty consistently a problem for the last several decades, predating modern LLMs.

So that is a structural problem with their data and security management and operations, totally independent of the architecture for doing large scale token inference.