Comment by FeepingCreature

The words "hidden" and "state" have commonsense meanings. If recurrent architectures want a term for their particular way of storing hidden state they can make up one that isn't ambiguous imo.

"Transformers do not have hidden state" is, as we can clearly see from this thread, far more misleading than the opposite.