Comment by rotis
1 hour ago
thinking_effort: max Reasoning trace: This is the classic pelican-on-bicycle SVG test.
Opus 5.5 had similar response on max: This is a classic test request
https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
I think your test is already embedded into the models. You should search for new frontier tests to subject the models to. Maybe they should now try to unify the standard model and general relativity in physics. I'm pretty sure this is nowhere to be found in any training data nor shared in any chat between a scientist and a LLM ;)
The fact that they've heard of the test doesn't seem to help them draw a good picture of a pelican riding a bicycle.