Comment by D-Machine

Before getting too hung up on memory and seeing these as key value stores, or self-attention is suppression of interference, recognize that a lot of experts and people in these areas disagree with this analogy for fairly deep reasons (I link other resources and discussion here: https://chatgpt.com/share/6ad3aa3d-d110-83ea-a8c5-8653b34743...