Comment by ActorNightly
6 hours ago
>. I have an M3 Ultra with 256GB of memory,
Im sorry but spending this kind of money when you could have just built yourself a dual 3090 workstation that would have been better for pretty much everything including local models is just plain stupid.
Hell, even one 3090 can now run Gemma 3 27b qat very fast.
Except if you are living in a region where electricity is quite expensive :/