Slacker News Slacker News logo featuring a lazy sloth with a folded newspaper hat
  • top
  • new
  • show
  • ask
  • jobs
Library
← Back to context

Comment by wasfgwp

15 days ago

The sample is too small. As long as the models are reasonable close enough to each other there is really nothing you can learn from this benchmark when its just one prompt.

It would perhaps be slightly interesting if the prompt was run 100 times for each model. I doubt the pelicans would look identical.

0 comments

wasfgwp

Reply

No comments yet

Contribute on Hacker News ↗

Slacker News

Product

  • API Reference
  • Hacker News RSS
  • Source on GitHub

Community

  • Support Ukraine
  • Equal Justice Initiative
  • GiveWell Charities