Comment by _heimdall
5 days ago
Since the LLM craze started I have always assumed it would end up in a place where programming languages are dead and LLMs generate something more low level.
Programming languages were always designed as an abstraction to allow humans to more easily instruct a computer than by writing binary or assembly. If humans write natural language and don't check the generated code, there's no reason to take the hit of generating C, JS, etc that still has to be compiled and/or interpreted.
If anything LLMs should use something higher level because it compresses the context and makes programming closer to natural language they are trained on.
Forcing LLMs to do a shitty job of what a compiler can do deterministically is not a good approach IMO.
Low level was the wrong term for me to pick there. I was meaning more along the lines of "purpose built". I.e. I could see a language, potentially still an abstraction requiring a compiler, that isn't meant to be particularly meaningful or inspectable by humans. For LLMs your right, conciseness would be important and that would likely mean it would be compiled.