Comment by cyanydeez

I think you're missing the reason LLMs work: It's cause they can continue predictable structures, like a human.

The surmise that compiled languages fit that just doesn't follow. The same way LLMs have trouble finishing HTML because of the open/close are too far apart.

The language that an LLM would succeed with is one where:

1. Context is not far apart

2. The training corpus is wide

3. Keywords, variables, etc are differentiated in the training.

4. REPL like interactivity allows for a feedback loop.

So, I think it's premature to think just because the compiled languages are less used because of human inabilities, doesn't mean the LLM will do any better.