Comment by nemo44x
1 day ago
The $100/month guy for inference isn’t the prize. It’s the thousands of companies spending millions/month.
It’s not unusual for someone to spend $5k in a week. 2 guys at my place just spend $150,000 over 3 months building out a factory.
We are aggressively exploring open weight models now.
Wish there were more case studies on what people were actually doing. Building out an entire factory sounds amazing. Are they actually getting that level of value out of AI?
Sounds like this will be another one of those things where everyone makes their money and it then will eventually become something experienced people 'blog' about.
> Wish there were more case studies on what people were actually doing. Building out an entire factory sounds amazing. Are they actually getting that level of value out of AI?
I don't doubt it.
> Sounds like this will be another one of those things where everyone makes their money and it then will eventually become something experienced people 'blog' about.
Or not. The problem is that right now you and a whole bunch of others are trying to outrun a pack of lions. The lions have already taken down a couple of your group. The people further ahead have seen what the lions can do and they are attempting to speed up to the point that they can outrun them. Whether that will work or not depends to a large degree on what the other people are doing and they are not going to make it easier for them to keep pace.
That partially explains the lack of deep insight blog posts, besides everybody is just too bloody busy.
They probably meant a software factory, ie a way to churn out slopware.
Yes. And yes you can churn slop. And I’m sure many will and many will get stuck with a source base that grows bigger than LLMs can cope with and becomes unmaintainable.
But you can also have many engineers operating it, testing outputs like you would in a real factory, etc.
Will be interesting to see how this pattern evolves. If it even makes sense.
1 reply →
Don’t know why this was downvoted but basically correct. OpenAI is in a price war with Anthropic right now for enterprise api consumers and that’s the biggest revenue line item for both.
They were counting on a duopoly so they could split the market between them but then someone decided to spoil their little party. To what degree that was an accident is anybody's guess but the timing is certainly interesting.