Comment by XYen0n
19 hours ago
The only thing a model can output is tokens; to achieve this, a tool of converting tokens into operational transformations is required. For example, I have an ast-grep skill, it will instruct the model to generate ast-grep rules and run ast-grep to perform file modifications.
I am saying to directly output the operational transformation instructions as the tokens. You’re essentially telling it to “write the diff” and then applying the patch.
[retain(8), delete(6), insert("very very"), retain(10)]
OpenAI models emit a format similar to a regular diff, but without the line numbers. Look at apply_patch
there is a model in openrouter doing exactly this, it generates diffs. forgot the name though