Comment by WarmWash
4 hours ago
>2) LLMs are extremely useful right now for certain niche tasks, especially software engineering.
Don't get lost in the tech scene sauce, programming is a small sliver of what people are using LLMs for. OpenAI's report in September pegged it at ~4% of tokens being for software generation. Sure Anthropic is probably 80% or something, but only a small sliver of LLM users are using Anthropic. The reality is probably even less if you count Google's AI overviews. We hate it, but I have never seen a regular person skip over it.
The question is if regular people will pay cell phone level subscription costs ($70-$100/mo) for LLMs. If so, then we are probably not in a bubble, and the ROI will have a 5-10 yr horizon, which is totally tenable.
500,000,000 people paying $75/mo is $450B/yr. Inference is cheap too, it's training that is ludicrously expensive. Don't be fooled by the introductory pricing we have today either, that's just to get you dependent.
And yeah, chinese models, but look at what they did to tiktok. No way they are going to let the Chinese government be peoples confidants and no way is more than 0.01% of people gonna home lab.
You’re right to call out consumer use is what’s eating all the tokens. I suppose what was behind my way of putting it is: I haven’t seen much in the way of truly transformative products with LLMs in the consumer space. Sure, there’s a few power users doing some cool things, and lots of promises along the lines of “AI will plan and book you a whole vacation!”, but basically for the median consumer we have an “improved search”, and “fun image generation”, with people using it a couple times a week. So what is the product that changes the world and makes 500M people pay $100 a month? I don’t think it’s really here yet. This feels a bit like we’re in 1996 where people are still trying to figure out what the internet is for, and we don’t know if OpenAI will be 1996’s Amazon, or its AOL.
None of this is to deny how remarkable the underling LLM tech is. I never expected to see something like this in my lifetime; it feels far far more strange and new than when the iPhone came along. I use a coding agent daily and it’s dramatically changed how I work. But I still think we’re in a bubble here.
Do you use cursor personally? the product is so good, i don't know why people aren't looking at the "companies will complain and pony up $20k a seat" isn't seen as a possibility here
> 500,000,000 people paying $75/mo is $450B/yr.
Majority of people use ChatGPT for free, that's why they are introducing ads. Normal people will not pay 70-100$ per month for LLM subscription. Your numbers are way off.
I'm sure if cell phones were free, the majority would be free users too.
But beside that, OpenAI is pricing ads at $60/1000 views. That is 3x what Meta charges, which is around $20/1000. Meta pulls about $20/user/month in ad revenue. Triple that and we land at....$60/mo.