← Back to context

Comment by dnautics

3 hours ago

> If you're using AI, a language with a large training set is going to win

Not necessarily? What if the training set contains an overwhelming amount if bad code written by neophytes? I imagine Python quality by the LLM suffers from this, for example.

What if the language has extremely confusing syntax constructs (like early php) or bad or no conventions (suppose the standard library has somecollection.put(key, value) sometimes and othercollection.put(value, key) other times), and individual code authors just pick what they want adhoc

Large training set ain't gonna save you.

There's a lot of RL that goes into this, you're not just training on bad code. Python is one of the programming languages that LLMs consistently perform best at.

  • Near bottom on auto coder benchmark from last year, so clearly claiming "consistently" is false or misleading. Did you make that up?