Comment by SideQuark
7 months ago
This advance likely uses more compute than the authors in 2009 could have imagined. It most certainly is not drastically reduced effort.
7 months ago
This advance likely uses more compute than the authors in 2009 could have imagined. It most certainly is not drastically reduced effort.
That assumes that compute = effort, which is not how most people would interpret it I think.
Anyone in computing, especially things related to deep learning, do.
If you prefer to think of human effort, there was also immense human effort building the models, the needed infra, assembling the data to train on, etc. There's usually 1000+ specialists on projects like this (see the last chat gpt paper author list, which took pages and pages as an appendix).
There is no way I can think any of this result was anything more than a massive effort, costing 10s to 100+ millions of dollars.
Go ahead and explain how this was low effort.