The average person may not even own a personal computer, has a company-owned notebook with barely 16 GB of RAM and maybe a TPU, and here you are saying that owning a prosumer GPU and more RAM than what most people will buy across their entire lifetimes is common.
I'd have to spend what, 5-10k today to run flash models? It can't be justified as long as I have Luna on 20$ sub. I'd have to be doing so much heavy unsupervised work for the economy to make sense.
The number of people who have 192GB RAM at their disposal is minuscule because there was no reason to have that much just recently unless:
1. You're a professional in some compute heavy field AND
2. You don't use a cloud or in-house enterprise infrastructure
The average person may not even own a personal computer, has a company-owned notebook with barely 16 GB of RAM and maybe a TPU, and here you are saying that owning a prosumer GPU and more RAM than what most people will buy across their entire lifetimes is common.
The average person doesn't have an interest in AI either.
I'm talking small and medium businesses, who have productive gains using AI, where a 3k€ PC is common. We have many.
> has a company-owned notebook with barely 16 GB of RAM
Mind you, some local models run on 16GB of RAM, with some headroom to do development work.
> Not completely obvious.
I'd have to spend what, 5-10k today to run flash models? It can't be justified as long as I have Luna on 20$ sub. I'd have to be doing so much heavy unsupervised work for the economy to make sense.
The number of people who have 192GB RAM at their disposal is minuscule because there was no reason to have that much just recently unless: 1. You're a professional in some compute heavy field AND 2. You don't use a cloud or in-house enterprise infrastructure
If you think that 192GB of VRAM on a video card that costs 3k€ is "pedestrian", I think you're a bit out of touch with the average consumer.
12 months ago buying 192 gigs of ram was pedestrian? Really?
Just checked, 192GB of DDR5 was 500€ vat excl. That's what we paid per for each set of 4x48.
500€ for a production tool seems fairly innocuous. We're not in the 10k€+ workstation territory here. At least we were not.