Comment by randomImmigrant
5 hours ago
What the blogificafion of AI research has done is allowed all kinds of claims and terminology related to AI to be introduced and taken up in a manner replicating social media dynamics. And that is simply not healthy. We’re fast reaching a place where any claim can be backed up with a set of numbers from a number of experiments run in some gamified environment or the other, with little concern for if it all adds up to anything. It’s a vicious loop, because this same junk then goes in to train the next models which help spit out the next set of models AND blogs/papers. The net effect is not dissimilar to setting termites loose in a library.
> We’re fast reaching...
We already arrived at that destination a decade ago.
Probably even further back tbh.
There's just a lot more people playing the game now, without the social indoctrination that made it more tolerable in some circles.
It's not that bad, though. September is annoying but you kind of miss the eternal renewal once you're out.
How is that different from traditional research publication? It's faster?
Top line difference is speed. The impact of speed is deeper and gets felt over time.
Traditional research publications are no angels. They gatekeep research, and also allow financial incentives to drive them to publish junk with their stamp on it.
But a flood of papers doesn’t actually mean more knowledge. In bypassing this route entirely, AI has swiftly lost the ability to engage with itself as a field. And the cost of that is only beginning to be felt.
No traditional research is mostly done by post-docs and have a phd level of education rather than a tech bro that passed leetcode. That seems like a good bar to have; not too mention the whole peer review thing, hard to really understand anything if you purposely withhold it and tell people to kick rocks.
Plenty of research is performed by non PhDs.
The main difference is reproducibility and peer review process.
Two separate axes here: whether the research is in a blog, and whether it’s peer reviewed.
On the first, I mostly don’t care.
On the second, that’s mostly unavoidable if they want to keep their IP.
Science is a method of inquiry, not an institution or group of people with titles.
2 replies →