← Back to context

Comment by meowface

17 hours ago

All of these arguments can easily be restated to apply to pre-AI coding, too.

Lack of complete understanding will continue to be a big problem, but I'd bet things will be net better off than before AI, because each year will give us LLMs that are better and better at good engineering, architecture, and design decisions.

Why so sure they will get better and not just plateau? They seem to be doubling in cost each time with less notable gains, the economics seem increasingly shaky, and potential problems with model collapse and context window size has not been solved afaik.

  • I just very strongly suspect it. There will be a plateau but a few years after, that, too, will be surpassed.

    We are extremely early in the history of AI and even the history of LLMs. I'd easily make a bet with anyone on that.

    • AI research started in the 1950s, and has always led to AI winters as promising areas of research peak.

      I suspect they are stealing your data when you install the apps, but if these companies are acting legally and not doing that, I can see no way they can avoid model collapse now that the internet is mostly unusable slop.

      3 replies →

A big problem for whom? The AI providers? If people don’t have a use for AI stuff that’s fine