Comment by wincy
1 month ago
OpenAIs opsec must be amazing, I had fully expected some version of ChatGPT to be leaked on torrent sites at some point this year. How do you manage to avoid something that could be exfiltrated on a hard disk from escaping your servers in all cases, forever?
People who have had access to the raw weights of ChatGPT are worth more now (presumably millions in SBC) selling their credentials to other labs. Why bother with trying to leak ? In any case other labs catch-up to the capabilities within a few months.
The model size is probably the thing here. I suspect they took the FAANG remote workstation approach, where VScode runs on a remote machine. After all its not that great having a desktop with 8 monster GPUs under your desk. (x100)
Plus moving all that data about is expensive. Keeping things in the datacenter is means its faster and easier to secure.