Comment by jbellis
5 hours ago
Your limitation after prefill is memory bandwidth. A maxed out Studio has less than a single 3090 (really).
5 hours ago
Your limitation after prefill is memory bandwidth. A maxed out Studio has less than a single 3090 (really).
Yeah, the 3090 has faster memory, but not by a lot.
The 5090 is at 1,792GB/sec and potential M5 Ultra would be 1,230GB/sec and 512GB RAM. Maybe 1TB. Not 32.