Comment by avetiszakharyan
10 months ago
I was just trying to make sure is maximally performant, and did it with MLX because i am running on mac hardware and wanted to be able to run 30b in reasonable time so it can actually autonomously code something. Otherwise there are many ways to do it!
It would be nice if you mentioned it's about apple silicon, and not apple intel computers. They're still ubiquitous nowadays
we're on the 4th generation of silicon now