Comment by alexchansg

3 days ago

Great insight. We noticed something similar when building our agent tool — LLMs would output git commit -m "..." with the quotes already formatted, even when we just wanted the message body. They're mimicking documentation examples, not actual command entry.

Ended up just accepting it and adjusting our parser. Fighting the model's training is a losing battle.