Comment by wongarsu
7 hours ago
File hosting is pretty cheap. Egress traffic is about $90/TB in the cloud, but around $1/TB in the real world. Storage is in the realm of $5/TB/month after adding redundancy
At the scale of Huggingface, that still amounts to a lot load of money. Significantly less than if you did the same in AWS, but still a lot
That said, they do have a deal with AWS to make the data available in AWS ip space. Maybe they got some cheap hosting out of that too
It's less than $1/TB. If you have settlement-free peering it's like fractions of a penny at scale. Cloud provider DTO pricing is literally the biggest scam on Earth.
My company spends $8,000,000/month on storage and $4,000,000/month on data with aws... In the financial reports we do we round this number away. Make of that what you will
What does DTO mean in this case? And settlement-free peering? I didn't know the price for S3 could be so cheap with AWS