← Back to context

Comment by hoppp

3 hours ago

Most humans have weak meta-cognition, a large percentage doesn't have verbal thoughts.

Meta-cognition makes sense in a dynamic and updatable and modular system, for example I can monitor thoughts coming from my amygdala with my prefrontal cortex and then adjust how I process these thoughts.

In LLMs it makes zero sense, even if you feed the output of one model into another, there is no way they can update the heuristics behind how those were computed.