← Back to context

Comment by pton_xd

7 hours ago

> My model doesn't need to know a single line of python.

If I had to guess, the weights necessary to encode "how to program" are much larger than the final step of "output python."

<THAT'S A BINGO>

ie what everyone asking for this fails to immediately realize.

  • You're a bingo. It's obvious that a model could know no Python, since Python could not exist in the world in the first place.

But the understanding of the language library ecosystem, or even better, your codebase, could let it execute faster and with less context usage.

  • That's the bit I feel you can do with ragging - keep a large library of well described solutions and then find what you need from it at runtime.