Comment by pyrophane
21 hours ago
I just have a desktop at home that I run inference off of. It is a great setup and I don't find myself wanting to inference models directly on my laptop.
21 hours ago
I just have a desktop at home that I run inference off of. It is a great setup and I don't find myself wanting to inference models directly on my laptop.
That’s what I would do too, but I haven’t found a desktop build that can rival a Mac Mini or Mac Studio on performance per watt. I haven’t looked super hard, but it seems like Mac is in a different ballpark.
I mean, once it's a desktop, watts are pretty cheap, so it's a bit strange to optimize on that factor for the desktop form factor. For laptops it makes a ton of sense.