Comment by 7734128
2 days ago
The problem with this is obviously that the only GPT 5.5 thoughts that we have access to are from stolen thought.
Qwen 3.8 0902 was trained after the release of the paper on August 10, so it should have seen those specific thoughts.
seems like only the companies in question could run this sort analysis long-term; since they have full access to their CoTs not in public datasets.
and we have to "trust them bro" to be fair and accurate, something I am very unlikely to do given their other false / misleading statements to date
And the only end result would be that the Chinese trained on their data just like OAI and Anthropic trained on our data so who cares
2 replies →
The thoughts trick was known before their paper / August.
I "independently" "invented" it for the first Anthropic reasoning models because the API required you have thoughts for each assistant message. My app lets you switch AIs within a chat, and their API used to require thinking for all messages if thinking was enabled, so I needed to get a valid thinking stub to insert.
Time has flew by for me the last 3 years, but, I'd guess it's been at least 18 months. And IMHO it wasn't very complicated to work through how to do once you were dead set on making it happen. I expect it was well-known to distillers before the paper.
Sure, but TFA is trying to use Qwen's reaction to the thoughts as proof that they did indeed extract thoughts to train on.
My point is that any model trained after August 10 will know of those specific thoughts.
I'm sorry, it's going over my head still - my reading is "all models with any training after August 10 know how GPT 5.5 Pro thinks", but I'm not sure why - my initial guess was that's when GPT 5.5 was released, but that doesn't seem to be the case (it was released April 23rd).
3 replies →