Comment by causal

6 hours ago

Right I was going to say, no way of knowing whether these issues are unique to Chinese models.

Depends on whether the models report the correct amount of tokens.

5.5 Sol repors 10x fewer reasoning tokens than Kimi k3. If it is correct, than it unlikely has those doubt issues.

At the same time, I feel like their reporting is incorect and we are now paying per "intelligence", not actual tokens. We can't verify it anyway..