Comment by ants_everywhere
1 year ago
> is proof that architectures aren't fundamentally important in the curve-fitting paradigm (aka deep learning)
(Somewhat) fun and (somewhat) related fact: there's a whole cottage industry of "is all you need" papers https://arxiv.org/search/?query=%22is+all+you+need%22&search...
Reminds me of the "Considered Harmful" articles:
https://meyerweb.com/eric/comment/chech.html
Quick, somebody write “All you need Considered Harmful” and “Considered Harmful all you need.”
Which seems closer to true?
All you need is all you need.
I wonder if there's something about tech culture - or tech people - that encourages them to really, really like snowclones.
Yes. Do stuff that other people have been successful doing. Monkey see, monkey do - it's not a tech people thing, it's a human thing.
Tech just happens to be most on display at the moment - because tech people are building the tools and the parameters and the infrastructure handling all our interactions.
1 reply →
Starting of course with the classic paper from Lennon and McCartney, 1967.