← Back to context

Comment by mountainriver

9 days ago

I vibe coded 5 deep ML libraries this month. I'm an MLE by trade and it would have taken me ages without AI. This wasn't possible even a year ago. I have no idea how anyone thinks the models haven't improved

> This wasn't possible even a year ago.

My experience has been that it was. I was using AI last year to build ML models about as well as I have been this year.

I'm not saying AI isn't useful, just that the progress certainly looks to be sigmoid not exponential in growth. By far the biggest year for improvement was 2022-2023. Early 2022 I didn't think any of the code assistants were useful, by 2023 I was able to use them more reliably. 2024 was another big improvement, but I honestly haven't felt the change (at least not for the better).

Some of the tooling may be better, but that has little do to with exponential progress in AI itself.

  • Wow really? The agentic coding work that has come out in the last year are super impressive to me.

    And before it didn’t seem to understand the fundamentals of Torch well, not well enough to do novel work. Now with Codex in high it absolutely does, and MLE bench reflects that