Comment by hereme888
6 hours ago
Another ad posing as "science".
It's basically a Wafer/AMD advertisement.
B300 is about 46% faster for one stream and 65% faster in aggregate. AMD wins only after Wafer divides throughput // selected cloud-rental prices: $2.50/GPU-hour for MI355X versus $6 for B300.
Benchmarks are unreproducible, power costs are missing, ROCm was patched... and on and on.
Sure, it can serve that particular model at that particular size more economically. Good for them... in particular.
Since we're (as a society) spending tens of billions of dollars to serve models like this, it's a pretty interesting advertisement.