Comment by visarga
3 hours ago
If you buy the computer specifically for inference it is more expensive than cloud, but if you had it anyway it's free.
3 hours ago
If you buy the computer specifically for inference it is more expensive than cloud, but if you had it anyway it's free.
True, but how many people (realistically) buy a computer with 48GB+ of RAM?
48gb of vram.
a machine like this is about a years rent for most people.
a small car for most others.
I think he’s talking about the Mac Mini unified memory.
48G RAM is pretty useful if you want to run k8s locally for tests / exploration