Comment by PlatoIsADisease
10 hours ago
Is there a catch? I was not getting anything like this on a 70B model.
EDIT: oh its a marketing account and the program never finished... who knows the validity.
10 hours ago
Is there a catch? I was not getting anything like this on a 70B model.
EDIT: oh its a marketing account and the program never finished... who knows the validity.
I don't think Awni should be dismissed as a "marketing account" - they're an engineer at Apple who's been driving the MLX project for a couple of years now, they've earned a lot of respect from me.
Given how secretive Apple is, oh my, its super duper marketing account.
Jeff Geerling and a few others also got access to similarly specced mac clusters. They replicated this performance.
The tooling involved has improved significantly over the past year.