Comment by addaon
12 hours ago
Which is an especially interesting option given built-in RDMA support with reasonable performance, including fully-connected graphs up to 6 machines…
12 hours ago
Which is an especially interesting option given built-in RDMA support with reasonable performance, including fully-connected graphs up to 6 machines…
Didn't take me long to find a nice proof of concept, 4x mac studio cluster in this case:
https://www.jeffgeerling.com/blog/2025/15-tb-vram-on-mac-stu...
you're still limited to TB5's 120Gbps speeds vs 1.2Tbps memory bandwidth on M5 Ultra
What sort of jobs are memory bandwidth bound that people are running? Will they actually see 10x speed improvement or hit some other real world bottleneck? Are these jobs "short" on the order of seconds or minutes or is the node being hammered for two weeks straight? I'm just curious about it.
> What sort of jobs are memory bandwidth bound that people are running?
CFD, for me. Depends on how you segment the domain, but the speed hit can be significant.
[flagged]