Comment by WithinReason

Some transformers have a block recurrent structure, here is a paper that made a similar observation recently:

https://www.alphaxiv.org/abs/2512.19941