← Back to context

Comment by fny

13 days ago

"These chat transcripts may even be read by human reviewers."

PSA: This is true of all the frontier model providers even if you disable activity tracking. They are all constantly monitoring your interactions for problematic behavior.

[0]: https://www.nytimes.com/wirecutter/advice/ai-chat-privacy/

[1]: https://www.404media.co/inside-project-lily-the-humans-readi...

[2]: https://www.winknews.com/news/woman-arrested-after-ai-threat...

The sole reason LLMs has gotten this good is because their aggressive expansion has been accompanied with literally this. The amount of uncredited information these models have been fed must be astonishing, also terrifying.

  • Why do you think they’re getting into consulting now?

    Imagine all those tasty confidential IP and contract documents they have ingested. You couldn’t buy those.

That is, fundamentally the marketing ploy of “AI Safety”.

For an AI system to be “completely safe”, like a self-driving car, it must map the full environment it operates in and be taught the “right way” to handle every conceivable scenario.

So when you present it with novel data or a situation, that constitutes an “AI safety event”, which per their ToS is a carve out for training on your session.

Further, go read the ToS carefully about what you opt out of. You’ll note there’s nary a mention of tool calls. You’re only opting out inputs (what you type) and outputs from the model from being trained on. All the content of the tool calls made while running on your system are fair game for training.

  • Well for us Europeans, GDPR explicitly allows them to store pretty much anything if somebody can claim it’s for safety.

    It’s literally just complicating things and providing zero reassurance to us AI customers.

  • Additionally, how stable are those ToS? Do they change every few days, like their models?

    • They stay pretty stable, but you also essentially agree to the content of the model specs and previous versions, which is thousands of pages you’re in essence agreeing to.

I can guarantee you that multiple people are reviewing some chats. This is very similar to Apen and whatever company prior to that for reviewing Google searches. They'd hire out contractors with NDA.