Comment by pests

> so logprobs of tokens after the bug happened might only be slightly higher than normal.

Sounds like it’s easier to pinpoint the bug.