Comment by hnfong

It means there's a non-trivial chance a future version of the model will know private information about you.

Maybe you're super careful with this stuff, but with agents and harnesses being given access to user data and accounts, I don't think it's feasible to actually monitor what information is uploaded and whether they involve private information.

I personally keep local models around because of this.