← Back to context

Comment by mt_

4 days ago

For me it's the reverse, it gives very shady vibes.

Remember the relatioship incentive is skewed, you are giving in your precious data inexchange for random logprobs, that they offer to "cheap".

They’re upfront about their decisions and intentions. All of which make perfect sense. What gives it shady vibes for you?

Eg: Longer context has long been known to reduce response accuracy, so it makes perfect sense why they’d limit it especially at launch. Personal evals are in fact more useful than public benchmarks so it makes sense (and is refreshing) that they’re cautioning against them…