Comment by throwaway219450

I used to assume it was the fault of average human annotators. That the people who are paid peanuts to rank chat outputs preferred the pretentious sounding ones. It wasn’t until quite a bit into the LLM boom that companies started to pay for domain experts. Overt watermarking is another possibility.

I’ve noticed that Sol is pretty good most of the time, but with long contexts it’ll start to devolve into Claudish.