Comment by Magi604
4 months ago
So many models coming out these days, so many developments happening in the AI space in general, it's kinda hard to keep up with it all. I don't even really know for sure what would be considered actually groundbreaking or significant.
I try to generally keep up with the overall trends, but I’m an engineer at a resource-constrained startup, not a research scientist. I want to see real-world application, at least mid-term value, minimum lock-in, and strong supportability. Until then, I just don’t have time to think about it.
You may both be interested in this newsletter
https://nlp.elvissaravia.com/t/ai
I'd be interested to hear why people are downvoting this.
8 replies →
For me nothing has been groundbreaking nor significant. What we are seeing is the same in every new innovation, a suite of micro-innovations which improves efficiency and reduces cost.
But LLMs are still fundamentally a stochastic parrot that depends heavily on source data to produce useful results. So we will go through a lull until there is some new groundbreaking research which moves everything forward. And then the cycle repeats.
No-one really knows until the dust has settled. Look back 12+ months and the picture will be much clearer.
Trying to drink from the firehose of ML research is only valuable for extremely active research participants. Can be fun though :)