Comment by jmartinpetersen

1 year ago

> "As LLMs drastically improve, the generated output becomes more drastically average"

Thanks, that really made it click for me.

2 comments

jmartinpetersen

Reply
sneak  1 year ago

Average software developers producing average code cost high five to low six figures per year.

LLMs are a tiny tiny fraction of that.

For a majority of software, average code that does the CRUD thing or whatever is fine.

Even if LLMs never get better or cheaper than they are today, our entire industry is forever changed (for the better).

Der_Einzige  1 year ago

I don't know how many times I'm going to have to post just one of the papers which debunk this tired trope. As models become more intelligent, they also become more plural, more like multiplicities, and yes, much more (super humanely) creative. You can unlock creativity in today's LLMs by doing intelligent sampling on high temperature outputs.

https://openreview.net/forum?id=FBkpCyujtS