Comment by nowittyusername

6 days ago

I don't think it will be a problem for long, as AI systems evolve they will be able to find those elegant solutions and explanations for you in due time...

6 comments

nowittyusername

Reply
jacquesm  6 days ago

AI does not care for elegance. That's one of the problems with the bulk of AI generated code: even if it does the job it is between 3 and 5x as much code as you would normally use to do the same thing. And even if we conclude that this is fine as long as the tests pass it is a massive barrier to understanding. Good code is easy to read. AI generated code - the bulk of the AI generated code that I've been exposed to to date, to be more precise - is overly complicated. Elegance is to do that which needs doing, no more, no less.

  • inglor_cz  5 days ago

    AI cares for whatever you reward it for, but we don't seem to care about elegance much either.

cat-whisperer  6 days ago

I doubt that. I don't think AI are trained to find elegant solutions, they are trained to find solutions. if you look at the things that OpenAI published, so seem to be micro improvements riddled with chaos. They are better solution, but they aren't drastic.

I have noticed this with autoresearch too, the solutions and improvments that you get are incremental and not groundbreaking. Humans, have a way find elegant solutions and also seem to solve that problem. Then again, beauty is in the eye of the beholder, and I might be wrong.

  • babilal  5 days ago

    Until elegance can be trained through RLVF, it will not be elegant. A lot of problems in AI seem to be finding ways to bring RLVF to more domains, as the current "spikiness" of AI seems to be mostly related to how effective RL is for a particular domain (if you need RLHF you are fucked and it's why it has not gotten better at writing and individual models still have "styles")

  • jacquesm  6 days ago

    Yes, spot on. I think it has to do with the lack of emotion. Humans enjoy finding something beautiful.

Bimos  5 days ago

Maybe the open problems are just by nature non-elegant and we human beings are bad at non-elegant mathmatics and found them either hard or not interesting before.