Comment by liampulles

What I've wondered about is whether there is a use in having an LLM that operates on AST symbols (or some IR representation) as input and/or output. It would be language specific of course (though maybe using something like MLIR is somewhat portable), but I would think it would result in a higher quality neural network, a reduction in tokens, etc.