Comment by datadrivenangel
1 day ago
LLM hardware wants to be shared. It's significantly more efficient economically to have expensive hardware be better utilized.
1 day ago
LLM hardware wants to be shared. It's significantly more efficient economically to have expensive hardware be better utilized.
I wouldn’t say so. Once local solutions pass a threshold of affordability consumers tend not to mind too much about their inefficient resource utilisation: see the many thousands of MacBooks which sit largely idle for most of the day. And efficient utilisation is actively against the interests of hardware manufacturers, at least while they’re not supply-constrained and looking to sell their limited supply to whomever can pay top dollar.