Comment by ai_fry_ur_brain

You people are delusional. How many times a day am I going to read this fiction of "good enough in a few years for most things".

There are physical limits to how much you can compress data and how much is needed for a capable model. If by hardware capable for running SOTA you mean a 7 figure investment for a company, than sure. But how come these companies didnt do the same thing for cloud? There's been this option for self hosting infrastructure for a decade but companies don't use it, they pay AWS.