Comment by ekianjo
3 months ago
LLMs produce much more consistent XML than JSON because JSON is a horrible language that can be formatted in 30 different ways with tons of useless spaces everywhere, making for terrible next token prediction.
3 months ago
LLMs produce much more consistent XML than JSON because JSON is a horrible language that can be formatted in 30 different ways with tons of useless spaces everywhere, making for terrible next token prediction.
Uh can't XML have whitespace throughout it just as much as JSON? They seem pretty similar in this respect.