Comment by lrvick
3 hours ago
I got insane amounts of Anthropic and OpenAI credits given to me for free for my startup, and I have not touched them.
I get privacy, freedom, and no rate limits with the GPUs I racked locally, and those are features I would never give up even if the surveillance capitalism labs paid -me- to use their models.
How many consumers are there like me? Probably not many, but once local inference hardware is plug and play, I bet the tides shift pretty quick. Also weights-on-silicon will serve the needs of most consumers locally with more speed than any GPU could deliver for a fraction of the cost.
Most people will be doing inference in their pocket or a wearable in 5 years and the giant datacenters will be like AWS, sold to only big organizations that need to auto-scale capacity of custom models on demand.
The industry surely knows this and the subsidized inference is just marketing to generate so much buzz and demand such that the tiny fraction of the market they will be able to keep in the end is big enough that they do not collapse under all the debt.
OpenAI and Anthropic will be Dell and IBM in 10 years if they survive at all.
Dell is trading at 4000% what it was 10 years ago
I did not imply otherwise. Just that both would be likely irrelevant to most consumers.