Comment by RGS1811
5 hours ago
"This is a classic test request..."
I know there's been discussion about whether pelicanmaxxing is happening, but this is at least evidence that Claude was explicitly exposed to this problem.
5 hours ago
"This is a classic test request..."
I know there's been discussion about whether pelicanmaxxing is happening, but this is at least evidence that Claude was explicitly exposed to this problem.
Of course it was exposed - not sure it's explicit or not. Why wouldn't HackerNews comments be part of the training data? And Simon's blog and the many discussions about Pelicans? It'd be hard to miss. Doesn't mean Anthropic has made this an explicit goal in training.
It would be genuinely shocking at this point if any of the frontier models weren't well exposed to the problem.
See here for more discussion of that: https://news.ycombinator.com/item?id=49803892#49804881
Just want to say: you’re such a legend, please do not stop sharing your pelicans, it’s always fun to see how they change over the months :)
Lets start frog riding motorcycle trend until they frogmaxx, or cat driving convertible.
The model recognizing the task doesn't mean it was benchmaxxed (RLVR-trained) to solve it. It might simply recognize it from pre-training on Internet text.