← Back to context

Comment by catoc

1 day ago

So when using Cowork on a local folder and asking it to "create a new spreadsheet with a list of expenses from a pile of screenshots", those screenshots may[*] become part of the "collected Inputs" kept by Anthropic.

[*]"may" because depending on the execution, instead of directly uploading the screenshots, a (python) script may be created that does local processing and only upload derived output

Yes, in general. I think in your specific example it is more likely to ingest the screenshots (upload to Anthropic) and use its built-in vision model to extract the relevant information. But if you had like a million screenshots, it might choose to run some Python OCR software locally instead.

In either case though, all the tool calls and output are part of the session and therefore Input. Even if it called a local OCR application to extract the info, it would probably then ingest that info to act on it (e.g. rename files). So the content is still being uploaded to Anthropic.

Note that you can opt-out of training in your profile settings. Now whether they continue to respect that into the future...

  • When local compute is more efficient data may remain local (e.g. when asking it to "find duplicate images" in millions of images it will likely (hopefully) just compute hashes and compare those), but complete folder contents are just as likely to be ingested (uploaded) and considered "Inputs", for which even the current Privacy Policy already explicitly says these will be "collected" (even when opting-out of allowing subsequent use for training).

    To be clear: I like what Anthropic is doing, they appear more trustworthy/serious than OpenAI, but Cowork will result in millions of unsuspecting users having complete folders full of data uploaded and persisted on servers, currently, owned by Anthropic.