Comment by jsatok
13 days ago
Contributed scores for the M3 Ultra 512 GB unified memory: https://www.localscore.ai/accelerator/404
Happy to test larger models that utilize the memory capacity if helpful.
13 days ago
Contributed scores for the M3 Ultra 512 GB unified memory: https://www.localscore.ai/accelerator/404
Happy to test larger models that utilize the memory capacity if helpful.
That's very interesting. I guess it just can't compete with any of the Nvidia cards? I would think your results should show up if sorted by "generation"– maybe the leaderboard is cached...
Non-VRAM based options of the moment are only competitive when it comes to the size of a model they can run, since the alternative is "you can't run it at that price otherwise".
Bandwidth at a given size is king, only then followed by enough compute to utilize it.
Ty for pointing this out, the results are taken from the db based on LocalScore, I will make some modifications to make the sorting better here