Comment by nozzlegear

1 day ago

> And the models of the future will surely be better than they are today. This stuff is still a very long way from maturity.

Since this is Claude, the models of the future might be more expensive, or more locked down, or might decide your 8yo is actually trying to build a cleverly disguised bomb so her request gets silently downgraded to a dumber model, etc.

14 comments

nozzlegear

Reply
swat535  14 hours ago

People tend to not realize how far these models have become.

I remember when they would always hallucinate APIs that wasn't there or make up fields that didn't exist.. those problems are virtually solved now.

So with that in mind, why wouldn't AI be able to write better code?

The code would have to be maintainable by AI itself (operating based on the assumption that the future will be Agentic Engineering)

  • kuschku  3 hours ago

    > I remember when they would always hallucinate APIs that wasn't there or make up fields that didn't exist.. those problems are virtually solved now.

    I love how people have said this for over a year now, and no matter how often I try it, it's still just as broken.

    Try it with any task that isn't in the training data. Say, a custom protocol where you need to cross-reference multiple implementations and the specs to really get it, and with no answers on stackoverflow or medium.

    At first it's hilarious, but after a while it just gets exhausting. For all these real-world tasks you need to put so much effort in that it's much easier to just write the code yourself, even with the latest (current Gemini) and greatest (Opus 4.6/4.7) models.

    If the parts for your project don't already exist, AI can't help you either. And if they do exist, why spend money on AI if the GitHub search is free and you can just fork and modify what you need?

  • nozzlegear  13 hours ago

    I don't use Claude, but isn't the consensus right now that Opus 5 is worse than previous generations? I suppose you could just commit to always using Fable and never use Opus, but it

    > might decide your 8yo is actually trying to build a cleverly disguised bomb so her request gets silently downgraded to a dumber model

    My contention isn't that models haven't improved or won't keep improving – my position is that the business goals of our American AI firms (Anthropic especially) aren't necessarily aligned with continuing to make those improved models available to the public forever. We need only look at the Mythos/Fable split for evidence of this happening already.

    https://www.reddit.com/r/ClaudeAI/comments/1vgpyni/my_opus_5...

    https://www.reddit.com/r/ClaudeAI/comments/1vgq0jm/opus_5_af...

    https://www.reddit.com/r/claude/comments/1vfvdgz/anthropic_l...

  • pessimizer  13 hours ago

    > So with that in mind, why wouldn't AI be able to write better code?

    > Since this is Claude, the models of the future might be more expensive, or more locked down, or might decide your 8yo is actually trying to build a cleverly disguised bomb so her request gets silently downgraded to a dumber model, etc.

    I have no idea what you're trying to add.

satvikpendem  13 hours ago

Models in general have gotten better, not specifically Claude, is what they mean; 4 years ago was when ChatGPT without any Anthropic was released.

fryanyway_swe  10 hours ago

There needs to be studies of people like this.

Same when one points out that yes, quality of life is in general much better now than 20 years ago even.

Someone like you will just pull out some stat "well THIS is worse!! I cant buy a house at 22!! The west is doomed and I LOVE China!"

  • nozzlegear  10 hours ago

    I think the ancient Greek philosophers already studied this thousands of years ago, they even came up with a term for it: "debate."

    https://en.wikipedia.org/wiki/Debate

    > In a debate, arguments are put forward for opposing viewpoints. Historically, debates have occurred in public meetings, academic institutions, debate halls, coffeehouses, competitions, and legislative assemblies. Debates have also been conducted for educational and recreational purposes, usually associated with educational establishments and debating societies. These debates emphasize logical consistency, factual accuracy, and emotional appeal to an audience. [...] The term "debate" may also apply to a more continuous, inclusive, and less formalized process through which issues are explored and resolved across a range of agencies and among the general public.

    tl;dr deal with it