Comment by utbabya
11 hours ago
Saw the question "Where would you most likely find a bat?", it occurs to me there's an innate tension, do we want the llm to be factually correct or do we want it to be more average human like? As an average human being not a sme on the subject my first instinct answer would be cave as well. I think it's reasonable to expect trainning on the aggregate of the internet means it would arrive at the same answer.
Edit: The context of the question does indeed make it sound more like the animal bat. The other answers sound more like gotchas to me.
The point is there is no right answer until we want it to be accurate in the domain we're working in. Like a sporting goods service would definitely want the baseball answer.