Comment by jephs

I think me just means neural network models RLed to Chain of Thought reasoning? The thinking tokens are the symbolic bit.

Smolensky's latest paper posted here the other day has some thoughts on how modern neural networks might beconsidered neurosymbolic, or rather "gradient symbolic processing," from another perspective entirely.

I wouldn't say the bitter lesson has given out! If you haven't noticed, these things keep getting bigger and bigger.