Comment by Schlagbohrer
3 days ago
Very funny at the end when they say that the strong safeguards they've built into Claude make it a good idea to continue developing these technologies. A few paragraphs earlier they talked about how the perpetrators were able to get around all those safeguards and use Claude for 90% of the work hahaha
I'd assume that means the servers are 'air-gapped' somehow. In that, the enterprise servers and the 'free' servers aren't on the same hardware.
Now, there is about a 0% chance that is true, and exactly a 0% chance that it even matters at all. They both use the same internet in the end.
So, then I'd have to imagine that they don't train the 'free' models on enterprise data, and that's what they mean.
But again, there is about a 5% chance that is true and remains so forever. Baring dumb interns and mistakes, eventually one day someone on the team will look at all the enterprise data, filled with all those high utility scores (or whatever they use to say data is good or not), and then they'll say to themselves 'No one will ever know, right? How could they? The obfuscation function works perfectly.' And blammo, all your trade secrets are just a few dozen prompts away.
Either that or they go bankrupt (like 23 and me) and just straight sell all that data to anyone for pennies (RIP).
Our locks are great, except when someone picks them effortlessly and robs the whole neighborhood... but that's why it's important to keep making better locks
[dead]