Comment by advisedwang
8 hours ago
The neural network in LLMs are not really that similar to brains. Here are a couple of the biggest differences:
1. Brains are plastic, making connections, breaking connections and changing "weights" on the fly. LLM have static weights. The best they have is writing to MEMORY.md or data getting used in the training run for the next model.
2. LLMs neural networks do not have loops. The best they have is that their output is available as future input, but that is not the same.
great perspective. makes you wonder how we will innovate onto this.