Slacker News Slacker News logo featuring a lazy sloth with a folded newspaper hat
  • top
  • new
  • show
  • ask
  • jobs
Library

Comment by jldugger

4 hours ago

Would 1.0 have fixed the wide variance in scoring?

1 comment

jldugger

Reply

nok22kon  1 hour ago

temperature is the wrong tool

the variance is caused by the bad evaluation prompt

if you ask "what is the capital of Paris" you'll always get Paris, with any (non-extreme) temperature

Slacker News

Product

  • API Reference
  • Hacker News RSS
  • Source on GitHub

Community

  • Support Ukraine
  • Equal Justice Initiative
  • GiveWell Charities