Comment by zambelli
10 hours ago
I trust the tool in that I don't send anything sensitive in there! Unless I built it, I assume it's going somewhere.
We have a policy at work around this where our most sensitive data can only be passed to on prem models.
That being said, I have no evidence of anything going to the cloud or frontier providers doing anything with chat history other than storing it for later.
Self-hosted + custom harness for anything I don't want getting out at all.
Makes sense. Does your custom harness give you a record of what actually crossed the boundary, or is it mostly trust-based blocking?
My harness is only being used with on prem models, so I don't have any checks in place. If the gguf is somehow calling home, I'm not catching it.