Comment by tintor
9 hours ago
Does your server have 20Tbyte+ of storage for frontier LLM weights?
It is too large to transfer in one HTTPS PUT request.
This needs to be S3 object store with multi-part upload spanning a long time period, to avoid trigger outgoing bandwidth monitors.
It goes to r2 and supports multi-part with 5 tib chunks
And your credit card limit is…?
about to be put to the test
2 replies →
r2 storage is pretty cheap, all things considered