Comment by Atotalnoob
4 days ago
There is randomness in LLMs. Both papers authors probably ran the bench 1-N times. Depending on that, they might select an average, max, least, etc. They might also have discarded outliers.
Like the other person said 5% variation is probably expected
No comments yet
Contribute on Hacker News ↗