Comment by novafunc

And when applicable, the program would be much more efficient than the LLM.

So it would really be beneficial for the LLMs to be able to have their own environments to write and run code, but also to store those programs for later use automatically.