Comment by kentm

4 days ago

Yep, this is still a thing. In the past year I’ve been throttled due to hot partitions. They’ve improved the partitioning so you hit it less, but if you scale too fast you will get limited.

Hit it when building an iceberg Lakehouse using pre existing data. Using object prefixes fixed the issue.