Comment by WarmWash
5 hours ago
Ironically coding has no relevance to something like 95% of users (I forget the exact OAI statistic), but it is the mainstay LLM benchmark.
5 hours ago
Ironically coding has no relevance to something like 95% of users (I forget the exact OAI statistic), but it is the mainstay LLM benchmark.
True, but coding is where something like 80%-90% of their revenue comes from; few other use cases are as token-hungry, and none of those are nearly as widespread. Many users will of course use the models just as chatbots, but they don't generate much in terms of revenue. And that is ultimately what determines where labs focus their resources.