Being an "aging brain" myself I can totally relate to this. I've been a relatively obsessive photographer (i.e. visual diary) since digital cameras were practical, i.e. over 25 years now. 238K photos in the collection so far, and I can actually find things in it.
And I've more than once found that an anecdote I've been telling has been incorrect, precisely in a "melded memories" kind of way. It happened at this sort of gathering which were usually held for that reason so X was involved... and then finally look at the old pictures and there's no sign of X. It is literally the brain invoking "lossy compression" to make it all fit, just like certain web services that let you upload pictures without limit might reduce old ones, that hardly anyone ever looks at any more, to lower quality to limit storage bloat.
Of course any married man can confirm that this only applies to men. Women's memories are flawless. If they claim that they remember a conversation exactly, word for word, 20 years later, who's to prove them wrong?
I think that's because memories really are highly compressed, with the average complex memory (of a grand day out, for example) being compressed into at most a paragraph of text's worth of information. Everything else is made up of context.
For example, having no photographic memory, I can remember the general "feel" of the innards of an antique shortwave receiver I used to have as a kid. But almost all of that is context. I know what canned octal base vacuum tubes and big tuning capacitors look like, what sort of components were in the big band selector "sled" (for geeks: This was an NC2-40D) and so on. So I can "zoom in" on the coarse memory by just filling in details that are generic, not specific. And these details may be from different sources than the original memory too.
And so the brain needs to remember - if one is not faceblind, which in fact I am - just the overall geometry of someone's face, and all the other stuff can be filled in as needed (how they look when they smile or are anxious etc.) Compression, compression. We have a lot to learn from nature. Note that a faceblind person does this too, of course - just not with a geometrically exact visualization of that person's face, just one with the correct "feel".
And that's also why synthetic memories can be formed so easily. You really don't have to insert much. The brain infers the rest as needed.
Perhaps the rate of occurrence changes, but everybody does this at every age. When even our experience is an interpretation of the real world, our memories are even less accurate.
Just throwing out an idea: I recently stumbled upon an old-school website where someone is uploading a photo of their day (almost) every single day since 1998.
Came across screen captures of the original Everquest (SO COOL) and other games, photos of anime/cosplay events, city shots, family, friends, etc. Really fun for them, and fun for people who like me who still enjoy surfing the web.
When my mom was still alive and relatively new to a smartphone (at age 80) I decided to send her some sort of relevant picture every day via Whatsapp, to get her used to communicating that way. Sometimes it was a real stretch to come up with something. But yes, this forces you to evaluate your life from that viewpoint "surely something was interesting today? Let's keep a picture of it". Even if it's just what I'm having for lunch that day.
Everquest looked sooooo good back then. Man! No more Meridian 59!
Why did you have to destroy my memories? :)
It's like looking at the first DivX encoded movie that was soooooo good vs. VideoCD/LaserDisc. And then you look at it today and it's so damn blocky and also in that tiny resolution. Ugh!
>I don’t think the sexist comment at the end is appropriate for HN
I don't think the ageist comment in the headline is appropriate anywhere.
It is well known that memories and perceptions at every age are largely constructed more as "what makes sense" ("no, a gorilla did not run across the basketball court") than "as recorded" recordings.
> Of course any married man can confirm that this only applies to men.
My first read of this headline was to observe that people seem to get more comfortable stereotyping people different from them as they age. Thanks for the datum.
I wonder how much of this is directly related to age (biological aging), and how much is just someone's brain becoming "full" due to more memories getting added every year?
It seems that memories must be stored as embeddings with single multi-neuron assemblies (cortical columns?) storing multiple embeddings as a kind of contents-addressable memory that is able to keep memories distinct due to the very high dimensional space (# neurons per assembly) being used. However, you'd expect that at some point if you store too many memories in a single assembly the recall accuracy is going to go down.
You'd expect that with big brains being so costly, evolution has only equipped us with brains big enough to store a lifetime of memories, so it would be odd if memory didn't suffer as we get old.
To make a computer analogy, it's a bit like a hash table getting too full. Say you had a hash table without any overflow mechanism... up to a point recall may still be pretty good, but as the table gets closer to full there will be more hash collisions and likelyhood of "false recall". Obviously the brain is not a computer, but the analogy may hold up reasonably well if you consider the hash table keys and values as embeddings and the store operation being an embedding merge rather than overwrite.
The brain does not have the Von Neumann bottleneck. Unlike most current digital systems, the brain doesn’t have a separate memory registry it needs to pull from.
Engrams, that is, the physical trace of a memory, are not stable through life. They start out in the hippocampus, but as the stimulus recedes in time without reinforcement, it moves away.
No evidence exists though that the memory is encoded in one set of cells. This spatial segregation of memory is the worst hangover from the “brain is a computer” analogy. Even if it is, why in the world would it be like our digital devices which specifically have the Von Neumann bottleneck? In biology, memory and processing are not segregated.
There’s growing evidence the memory is much more distributed over the network, and is recomposed based on salience overlap with a new stimulus.
Another factor to keep in mind is circadian rhythms. There’s growing evidence for how much the memory system and timekeeping system overlap, at a molecular level. Every neuron (and other cell) has an intrinsic clock that ticks at roughly 24 hours, and continues to do so even in total darkness.
When you encode the memory has a lot to say, based on your chronotype, on how and how well you will remember it. Same with learning: there’s a time of day based variation.
Sleep, and dreaming, is when these memories seem to get replayed and critical features and connections are incorporated into the system and its regime, awaiting the right triggers to access a state similar to when the memory formed.
I’m stitching across a lot of different research, and I want to be clear many aspects of this system are not yet fully worked out.
But what we do know points to a system that works with different physical and algorithmic priors, and the dynamics are sharply distinct from current digital computers.
Hijacking your post with a dubious segue because I’m itching to bounce these thoughts off somebody:
I’ve been consuming a lot of talks / writing recently about “enactive” pictures of how our brains function. From what I gather, recent studies have called into question the entire idea of real world concepts being “represented” by an area of the brain at all. While it’s true that atandard fMRI-style snapshots of brain activity are semi-stable over the course of a short experiment, it’s not true over longer timeframes. The response to the same stimulus will change over time. They refer to this as “representational drift” in the literature, and some people are using this to bolster theories of mind that they consider non-representational. They instead emphasize the brain as a kind of dynamical system that learns to “resonate” with the world to pull itself back into homeostasis. The focus shifts away from facts and memories as data, and sees neuronal plasticity more as a mechanism for tuning the brain’s resonant frequencies. This obviously places high importance on the spiking, recurrent nature of actual neurons, as opposed to the neurons-as-functions / back-propagation / ML approach.
My mind’s not made up on how interesting and revolutionary this approach is / isn’t. The distinction seems to be about whether learning is more like “writing to disk” or “tuning a PID controller” - but in either case, the world is leaving a stateful imprint on your brain that will impact how it processes future data. Is that important to understanding how brains work, or is it just semantics?
> The brain does not have the Von Neumann bottleneck
Obviously not, which is why I didn't say it did!
However, if you want to identify where long-term memories are stored, then that is in the cortex, but it should go without saying that this doesn't make the cortex the storage component of a von-Neumann architecture!
> No evidence exists though that the memory is encoded in one set of cells
I'm not sure what you are trying to say.
Memories are presumably stored as embeddings - a distributed representation, and an episodic memory may well be stored as "chained together" episodic "scenes/chunks" where each chunk recalls the next.
However, a distributed representation isn't the same as a holographic one, and any redundancy may well still be localized within given cortical columns, so I think you may be wrong if you are saying that individual memories/chunks are not confined to one set of cells (some localized neural assembly such as a cortical column).
None of that changes whether there is a physical capacity, which I think was the larger point? There is no reason to believe distributed memory doesn't suffer from the capacity component of the bottleneck. In fact iirc there was some late 80s/early 90s papers on the memory capacity of NN. Btw I would advise against the absolute statement that there's absolute segregation of memory and processing.
I guess my point is the brain not being "von Neumann" in architecture or digital is not proof that isn't a "computer" of some sort.
This is really fascinating. The actual mechanisms of the human mind are distinct from computer systems, yet there are some parallels.
There are some hints that increased memory access times scale with the amount of information the brain has stored vs the more typical narrative that aging decreases the capabilities of the brain.
> Our results indicate that older adults'; performance on cognitive tests reflects the predictable consequences of learning on information-processing, and not cognitive decline. We consider the implications of this for our scientific and cultural understanding of aging.
"His memory was so powerful that he could still recall decades-old events and experiences in the smallest details. After he discovered his own abilities, he performed as a mnemonist; but this created confusion in his mind. He went as far as writing things down on paper and burning it, so that he could see the words in cinders, in a desperate attempt to forget them. Some later mnemonists have speculated that this was a mentalist's technique for writing things down to later commit to long-term memory. Reportedly, in his late years, he realized that he could forget facts with just a conscious desire to remove them from his memory, although Luria did not test this directly."
I believe that one need to have superhuman memorization abilities to have definite confusion due to too much remembered. More trivial explanation of this effect in normal ageing persons is age-related brain shrinkage.
> Obviously the brain is not a computer,
Our brain consists of approximately 86 billions quantum computers [2] controlling tens-of-thousands chemical neural networks with at least 10 coefficients, communicating [4] using lasers [5] (coherent light is laser light).
Well, sure, it's a computer of sorts, although in the abstract sense of being able to perform computations so is our liver, so perhaps not a very useful concept.
What I meant (as I assume you realize) was "not a von Neumann architecture computer", but I'd also fairly confidently assert that it's not a quantum computer either.
Our ANN model of a neuron is obviously too simple (especially being a synchronous model, not a real-time asynchronous one), but it's hard to imagine that all of the classical chemistry, let alone quantum, details are important. It's necessarily built out of chemistry, but selection is happening at the level of behavior - presumably depending only on a much higher level set of abstract capabilities (ability to learn, etc), not the exact details of chemistry.
The success of LLMs, a crude prediction mechanism built atop a crude ANN, does tend to support the idea that low level details don't matter. Timing will matter if we want to go beyond LLMs to AI that can learn time-based things and not just sequence order, but how much else will matter remains to be seen!
I suspect the anxiety of being unable to forget things has an inherent selection bias. You will only stress over the things you can't forget, the things you have forgotten you won't stress over...
Generally claims of eidetic memories are overstated, doubly for older claims, but Nigel Richards memorized a French dictionary in 9 weeks, over 6k words a day, x2 including the alphagram.
I consider myself to have a decent memory, but that is 200x what I'd think myself capable of, assuming I want to retain it all at the end of the 9 weeks.
Our brain consists of approximately 86 billions quantum computers [2] controlling tens-of-thousands chemical neural networks with at least 10 coefficients
By that logic, a Blackwell GPU contains 208 billion quantum computers.
Each transistor is a quantum mechanical system and takes hundreds of model parameters to describe. So apparently a GPU is a 208-billion-node quantum supercomputer.
"The brain is not a computer" != "Parts / aspects of the brain do computation".
"A computer" in the first statement is IMO obviously intended in the common usage sense of the term, i.e. the brain is not a desktop computer or smartphone, or Turing machine, or etc, and thinking of it like these things will cause more error than insights. Also, billions of interlinked mini bio quantum computers arguably produce something with emergent properties and behaviour much, much more complex than "a computer". I am with GP, the analogy to "a computer" is not super helpful here unless you highly restrict the meaning.
But yeah, the Shereshevsky case is a super interesting one, thanks for linking!
I see it differently: as a teen, I could remember the exact word for lots of things, I could recall numbers and data with high precision. Nowadays, I'm pretty bad at all those things, but I can very well understand metaphors and connects concepts from wildly different topics — which I couldn't back then.
I see this kind of "interconnecting ideas" of my current years as somewhat connected with "fuzzy memory". It's like, when I retrieve data, it's not as precise, and sometimes I get neighbouring data, but that can actually of use.
I feel like I feel this increasingly as I age. I used to be able to remember nuanced details of API and computer systems. Now, so many of those memories simply get stored as “FLAG: double check the docs” (because I’ll forget).
I’m a lot better at assessing things from a high level, knowing where to find the information I need, and knowing how to assess it for accuracy - but I can’t remember details anymore. Books become summaries. Trips become a few key snapshots representing the trip.
I don't think there is a "full" state, but watching the changes as the years go by I have thought of collisions. Not really like a hash table, though--most collisions are with things that would be filed together. I think it's more like the brain returns a random item matching the category. Brains are expensive, memory that gets fuzzy with age is probably the better choice than trying to feed a brain that does better.
Yes, evolution is not going to penalize everyone with a "100-year brain" when the rest of our body seems optimized for something more like a 30-40 year lifespan. Evolution is all about propagating your genes, and not too many 100-year olds are going to be doing that!
In any case, fuzzy associative recall is really the "design spec" for a brain, so semi-graceful degradation and fuzzy recall comes for free.
I'm not sure if old-age memory unreliability is totally random - I would not expect it to be. I'd expect these associative recall failures to happen when there are too many memories partially matching the same "key" (activation pattern), which presumably happens mostly when they do have something in common.
Is it aging or the extra amount of information on the brain? If a young man is in a coma and wakes up as an old man will he experience the blend memories or will he remember things just as they were when he remembered them as a young man?
There's also the issue of the more we remember something the more we change it. Which could contribute to the blended memories.
The paper certainly has its limitations. Only 61 participants, with almost nobody between 30 and 50, so we shouldn’t read the age trend as a decline across lifespan. What’s more interesting than the title suggests (and I find the title forcing the conclusion a bit) is that the attention measures were not linked to age or the brain patterns at all.
Then again, i'm 45 and I've been losing my keys and my IDs since I was 20
The entire article is AI-generated.I wish such sources would include the prompting used as well as the model so a (human) reader can better evaluate the document.
> This process includes multiple checks using different LLM platforms, human editorial verification, and cross-referencing with original sources to ensure accuracy and eliminate false information, misleading content, fabricated content, bias, and unreasonable speculations or editorialization
The concept of memories blending together resonates after watching a recent Kurzgezadt video entitled "How Are Memories Stored Inside Your Brain?". It makes the point that the very act of recalling a memory changes it:
> But memories are not static like photos. Like dioramas made from wax, each time they’re under the spotlight of your attention they can melt and change a tiny bit.
I suspect my oldest memory, of me getting into a booster car seat as a child, is no longer the actual memory, but the accumulated imaginings of me trying to remember that specific memory, masquerading as a memory.
Comet Hale-Bopp is definitely a case of this for me. Although I remember a few interesting things about the process of seeing it, I have no idea of what it looked like to me.
I can remember the neighbors standing slightly in our yard and then explaining to my parents the comet and pointing it out to us. I can remember at some points that followed being aware of the parallax effect as it seemed to appear on either side of my other neighbors’ house as I walked up and down the driveway.
But just a year or so later, I knew that the picture in my memory was more like an illustration of a comet. The accurate image was completely gone even though the memories surrounding it remained, and in the place of that image was something that I had imagined.
Gonna chuck a thought for you all. In social situations there is someone who talks alot and I think they are able to do so because they have lots of stories they can recall in good detail (maybe not perfect) but 20 year old event they are describing better than I can describe last week. Now I assume they don't have that rare calendar level memory but they do have a huge storage of stories and events. I am pretty jealous tbh!
Also that skill is probably excellent for interviews which is the ultimate memory test. I.e. Tell me a time when you turned water to wine, plus 5 deeper questions, any hesitation will be chalked ip as suspicious AI use.
For me I either do or I remember which makes performance management and interviews hard for me (as someone vouching for someone as evidence is rare now).
It's interesting for interviews. I assume that people who have somewhat inaccurate memories but with a (possibly subconscious) egotistical filter do much better in interviews than those of us who have more accurate memories of exactly what our contributions to a project were. There are a lot of ways of stretching the truth in your favor, and they all seem much more natural if you really believe them.
My friend recently told me about seeing that an old coworker of hers from 20 years ago described her role as HR manager rather than HR assistant on her LinkedIn. I can easily see how someone with a fallible memory can retroactively exaggerate their title or responsibilities, especially when it's been 20 years.
I have a few friends and family members like that and for the stories which I was present, they always hit the broad strokes, but the finer details get switched around and sometimes the whole story has a major perspective shift.
My theory behind this is that when you encounter something new/novel it is distinct enough to remember -- where you were when you learned of 9/11; the days around the start of covid/lockdowns; being in a car accident; getting married; etc..
However, when you experience the same thing repetitively -- having breakfast; getting ready for school/work/etc. -- it doesn't make sense for your brain to remember each of these events as distinct events but to mush them together into a single or combined memory. This may be due to how the brain indexes/references memories and that memories with the same references get combined together.
This is also partly why time appears to go faster when you get older -- the same day-to-day events blend together but the key milestones (holidays, etc.) stick out.
By 'rewritten' do you mean refreshed, like learning material with spaced repetition, or some different/deeper concept? Do we 'move' that information to a different cluster of neurons?
This comes as absolutely no surprise to me -- my mother was recently transferred into memory care, and the changes to her memories are definitely showing some interesting changes. The foremost was that her new "apartment" is shared with one other person, gives off a bit of a dorm room vibe. First day, she was talking about how excited she was to be going back to school and seeing her boyfriends again(?!). I said, "Oh, like Doug? [my dad]". Her response? "Ew. No."
But, she's come around on that, and recently been upset about the affair he's been having (they divorced in 1980), and is irate over him having another kid with his new wife (1983), but isn't surprised that I haven't spoken to him in 12 years. She's never surprised at how I've aged, but doesn't remember her grandkids even exist and insists on meeting them soon (but remembers them when she sees them). Two weeks ago, she called to yell at me for things I did in high school (1990). At this point, I seem to be the anchor for everything recent, but when I'm not around physically, it's scattered everywhere else.
It's hard to write this, but before my grandmother died about 45 years ago, it felt like she'd lost almost all her memories, but was easy to take care of. She was in her late 80's.
My mom & aunt took yearly turns keeping her in their homes. If you kept her away from the stove, she still seemed quite happy helping fix her own breakfast, taking her meds, etc. Give her a warm washrag after, and she'd wipe down the table and then proceed to putter all around the kitchen, wiping and straightening. She preferred cartoons on TV (easier to see, I guess), and was always glad to fold clean towels or clothes, if she had the chance.
Once, she actually recognized me, and remembered my name. It was a very precious 5 minute chat, but then the memories were gone. Still, I'll always remember her that way, because it was just like how I remembered her, when I was a child.
Man, that makes me happy. I'm guessing your grandmother was a very upbeat, happy person who dealt with change well. My mother's the opposite, so now every little thing going wrong is the end of the world. It's rough, but I also get to see these moments where I can see how she was when I was little/before I was born, and those are moments that I do really enjoy.
I have some memories that I know for a fact are wrong in a pretty particular way. They’ve either become attached to the wrong place or the wrong time.
Like I remember a good friend picking me up from my childhood home, yet I didn’t even know that person until I’d long moved out (many years) from that place.
How much of this, I wonder, is a function of the fact that our circadian rhythms get less robust with aging. The circadian clock hugely influences learning and memory processes, gating when you can learn and how much, and shaping the storage and recall also.
We know that with age the amplitude of these rhythms can decrease, as can the synchrony between cells.
This kind of mid-management seems to have at least some circadian component, and it would have been great if they looked to see if the effects were equally bad at all times of day, and knew the chronotype of the participants to use as a reference. I’d love to see if every test participant was tested at their cognitive peak, too.
Anecdatum: I confidently told a woman that her son, who was looking for a research opportunity in Berne, Switzerland, was heading for the birthplace of the World Wide Web, which is actually a couple of hours west and south at CERN.
I can't wait to tell my dad about this study. We recently got into a heated debate when he insisted that I was a toddler on a family vacation we were reminiscing about, when in fact I was a teenager on that particular vacation, and he was mashing it together with memories of a different vacation. He is 75 but is in pretty good cognitive health, no signs of dementia besides this unreliable long term memory.
Worth keeping in mind also is that memories are not a reliable facsimile of objective reality.
Instead, they are selective representations of parts of a subjective experience. It also means that memories aren’t static, but shift over time and can even be imagined.
Compaction is not even an intrinsic function of an LLM, but of it's harness or whatever code is calling it. When an LLM compacts something it's just creating a summary of the previous conversation using the same mechanism that it uses to generate any other text. It doesn't "forget" the text from before the summary, it just no longer receives it when it is invoked.
In contrast, when we forget something we are not summarizing anything, we are just losing the ability to recall something. We might remember what we have forgotten later on, showing that it is still somewhere in the mind, and that the reason we have forgotten it is not necessarily because it has been discarded.
Even then, what this article is talking about is not even normal forgetting as a function of the brain. It's talking about a degenerative and dysfunctional form of memory loss where different memories are confused with each other.
Being an "aging brain" myself I can totally relate to this. I've been a relatively obsessive photographer (i.e. visual diary) since digital cameras were practical, i.e. over 25 years now. 238K photos in the collection so far, and I can actually find things in it.
And I've more than once found that an anecdote I've been telling has been incorrect, precisely in a "melded memories" kind of way. It happened at this sort of gathering which were usually held for that reason so X was involved... and then finally look at the old pictures and there's no sign of X. It is literally the brain invoking "lossy compression" to make it all fit, just like certain web services that let you upload pictures without limit might reduce old ones, that hardly anyone ever looks at any more, to lower quality to limit storage bloat.
Of course any married man can confirm that this only applies to men. Women's memories are flawless. If they claim that they remember a conversation exactly, word for word, 20 years later, who's to prove them wrong?
But did you see the gorilla?
EDIT: https://en.wikipedia.org/wiki/Inattentional_blindness#Invisi...
Can confirm. This "aging brain" regularly and vividly inserts my child into memories created before they existed.
I think that's because memories really are highly compressed, with the average complex memory (of a grand day out, for example) being compressed into at most a paragraph of text's worth of information. Everything else is made up of context.
For example, having no photographic memory, I can remember the general "feel" of the innards of an antique shortwave receiver I used to have as a kid. But almost all of that is context. I know what canned octal base vacuum tubes and big tuning capacitors look like, what sort of components were in the big band selector "sled" (for geeks: This was an NC2-40D) and so on. So I can "zoom in" on the coarse memory by just filling in details that are generic, not specific. And these details may be from different sources than the original memory too.
And so the brain needs to remember - if one is not faceblind, which in fact I am - just the overall geometry of someone's face, and all the other stuff can be filled in as needed (how they look when they smile or are anxious etc.) Compression, compression. We have a lot to learn from nature. Note that a faceblind person does this too, of course - just not with a geometrically exact visualization of that person's face, just one with the correct "feel".
And that's also why synthetic memories can be formed so easily. You really don't have to insert much. The brain infers the rest as needed.
3 replies →
as you say, everyone does this. you just have the evidence and the humility to admit it.
Perhaps the rate of occurrence changes, but everybody does this at every age. When even our experience is an interpretation of the real world, our memories are even less accurate.
Just throwing out an idea: I recently stumbled upon an old-school website where someone is uploading a photo of their day (almost) every single day since 1998.
Came across screen captures of the original Everquest (SO COOL) and other games, photos of anime/cosplay events, city shots, family, friends, etc. Really fun for them, and fun for people who like me who still enjoy surfing the web.
edit: Screencap of an Everquest screencap for funsies: https://imgur.com/a/HUqc6p5
When my mom was still alive and relatively new to a smartphone (at age 80) I decided to send her some sort of relevant picture every day via Whatsapp, to get her used to communicating that way. Sometimes it was a real stretch to come up with something. But yes, this forces you to evaluate your life from that viewpoint "surely something was interesting today? Let's keep a picture of it". Even if it's just what I'm having for lunch that day.
But she's gone now and so is that habit.
5 replies →
Everquest looked sooooo good back then. Man! No more Meridian 59!
Why did you have to destroy my memories? :)
It's like looking at the first DivX encoded movie that was soooooo good vs. VideoCD/LaserDisc. And then you look at it today and it's so damn blocky and also in that tiny resolution. Ugh!
I don’t think the sexist comment at the end is appropriate for HN
>I don’t think the sexist comment at the end is appropriate for HN
I don't think the ageist comment in the headline is appropriate anywhere.
It is well known that memories and perceptions at every age are largely constructed more as "what makes sense" ("no, a gorilla did not run across the basketball court") than "as recorded" recordings.
> Of course any married man can confirm that this only applies to men.
My first read of this headline was to observe that people seem to get more comfortable stereotyping people different from them as they age. Thanks for the datum.
I wonder how much of this is directly related to age (biological aging), and how much is just someone's brain becoming "full" due to more memories getting added every year?
It seems that memories must be stored as embeddings with single multi-neuron assemblies (cortical columns?) storing multiple embeddings as a kind of contents-addressable memory that is able to keep memories distinct due to the very high dimensional space (# neurons per assembly) being used. However, you'd expect that at some point if you store too many memories in a single assembly the recall accuracy is going to go down.
You'd expect that with big brains being so costly, evolution has only equipped us with brains big enough to store a lifetime of memories, so it would be odd if memory didn't suffer as we get old.
To make a computer analogy, it's a bit like a hash table getting too full. Say you had a hash table without any overflow mechanism... up to a point recall may still be pretty good, but as the table gets closer to full there will be more hash collisions and likelyhood of "false recall". Obviously the brain is not a computer, but the analogy may hold up reasonably well if you consider the hash table keys and values as embeddings and the store operation being an embedding merge rather than overwrite.
The brain does not have the Von Neumann bottleneck. Unlike most current digital systems, the brain doesn’t have a separate memory registry it needs to pull from.
Engrams, that is, the physical trace of a memory, are not stable through life. They start out in the hippocampus, but as the stimulus recedes in time without reinforcement, it moves away.
No evidence exists though that the memory is encoded in one set of cells. This spatial segregation of memory is the worst hangover from the “brain is a computer” analogy. Even if it is, why in the world would it be like our digital devices which specifically have the Von Neumann bottleneck? In biology, memory and processing are not segregated.
There’s growing evidence the memory is much more distributed over the network, and is recomposed based on salience overlap with a new stimulus.
Another factor to keep in mind is circadian rhythms. There’s growing evidence for how much the memory system and timekeeping system overlap, at a molecular level. Every neuron (and other cell) has an intrinsic clock that ticks at roughly 24 hours, and continues to do so even in total darkness.
When you encode the memory has a lot to say, based on your chronotype, on how and how well you will remember it. Same with learning: there’s a time of day based variation.
Sleep, and dreaming, is when these memories seem to get replayed and critical features and connections are incorporated into the system and its regime, awaiting the right triggers to access a state similar to when the memory formed.
I’m stitching across a lot of different research, and I want to be clear many aspects of this system are not yet fully worked out.
But what we do know points to a system that works with different physical and algorithmic priors, and the dynamics are sharply distinct from current digital computers.
Hijacking your post with a dubious segue because I’m itching to bounce these thoughts off somebody:
I’ve been consuming a lot of talks / writing recently about “enactive” pictures of how our brains function. From what I gather, recent studies have called into question the entire idea of real world concepts being “represented” by an area of the brain at all. While it’s true that atandard fMRI-style snapshots of brain activity are semi-stable over the course of a short experiment, it’s not true over longer timeframes. The response to the same stimulus will change over time. They refer to this as “representational drift” in the literature, and some people are using this to bolster theories of mind that they consider non-representational. They instead emphasize the brain as a kind of dynamical system that learns to “resonate” with the world to pull itself back into homeostasis. The focus shifts away from facts and memories as data, and sees neuronal plasticity more as a mechanism for tuning the brain’s resonant frequencies. This obviously places high importance on the spiking, recurrent nature of actual neurons, as opposed to the neurons-as-functions / back-propagation / ML approach.
My mind’s not made up on how interesting and revolutionary this approach is / isn’t. The distinction seems to be about whether learning is more like “writing to disk” or “tuning a PID controller” - but in either case, the world is leaving a stateful imprint on your brain that will impact how it processes future data. Is that important to understanding how brains work, or is it just semantics?
4 replies →
> The brain does not have the Von Neumann bottleneck
Obviously not, which is why I didn't say it did!
However, if you want to identify where long-term memories are stored, then that is in the cortex, but it should go without saying that this doesn't make the cortex the storage component of a von-Neumann architecture!
> No evidence exists though that the memory is encoded in one set of cells
I'm not sure what you are trying to say.
Memories are presumably stored as embeddings - a distributed representation, and an episodic memory may well be stored as "chained together" episodic "scenes/chunks" where each chunk recalls the next.
However, a distributed representation isn't the same as a holographic one, and any redundancy may well still be localized within given cortical columns, so I think you may be wrong if you are saying that individual memories/chunks are not confined to one set of cells (some localized neural assembly such as a cortical column).
3 replies →
None of that changes whether there is a physical capacity, which I think was the larger point? There is no reason to believe distributed memory doesn't suffer from the capacity component of the bottleneck. In fact iirc there was some late 80s/early 90s papers on the memory capacity of NN. Btw I would advise against the absolute statement that there's absolute segregation of memory and processing.
I guess my point is the brain not being "von Neumann" in architecture or digital is not proof that isn't a "computer" of some sort.
3 replies →
Does this mean we have unlimited memory storage?
This is really fascinating. The actual mechanisms of the human mind are distinct from computer systems, yet there are some parallels.
There are some hints that increased memory access times scale with the amount of information the brain has stored vs the more typical narrative that aging decreases the capabilities of the brain.
> Our results indicate that older adults'; performance on cognitive tests reflects the predictable consequences of learning on information-processing, and not cognitive decline. We consider the implications of this for our scientific and cultural understanding of aging.
[0] https://pubmed.ncbi.nlm.nih.gov/24421073/
A fascinating story of "Patient Sh." [1], the man who did not forget.
[1] https://en.wikipedia.org/wiki/Solomon_Shereshevsky
"His memory was so powerful that he could still recall decades-old events and experiences in the smallest details. After he discovered his own abilities, he performed as a mnemonist; but this created confusion in his mind. He went as far as writing things down on paper and burning it, so that he could see the words in cinders, in a desperate attempt to forget them. Some later mnemonists have speculated that this was a mentalist's technique for writing things down to later commit to long-term memory. Reportedly, in his late years, he realized that he could forget facts with just a conscious desire to remove them from his memory, although Luria did not test this directly."
I believe that one need to have superhuman memorization abilities to have definite confusion due to too much remembered. More trivial explanation of this effect in normal ageing persons is age-related brain shrinkage.
Our brain consists of approximately 86 billions quantum computers [2] controlling tens-of-thousands chemical neural networks with at least 10 coefficients, communicating [4] using lasers [5] (coherent light is laser light).
Live with that. ;)
> Live with that. ;)
Well, sure, it's a computer of sorts, although in the abstract sense of being able to perform computations so is our liver, so perhaps not a very useful concept.
What I meant (as I assume you realize) was "not a von Neumann architecture computer", but I'd also fairly confidently assert that it's not a quantum computer either.
Our ANN model of a neuron is obviously too simple (especially being a synchronous model, not a real-time asynchronous one), but it's hard to imagine that all of the classical chemistry, let alone quantum, details are important. It's necessarily built out of chemistry, but selection is happening at the level of behavior - presumably depending only on a much higher level set of abstract capabilities (ability to learn, etc), not the exact details of chemistry.
The success of LLMs, a crude prediction mechanism built atop a crude ANN, does tend to support the idea that low level details don't matter. Timing will matter if we want to go beyond LLMs to AI that can learn time-based things and not just sequence order, but how much else will matter remains to be seen!
I suspect the anxiety of being unable to forget things has an inherent selection bias. You will only stress over the things you can't forget, the things you have forgotten you won't stress over...
Generally claims of eidetic memories are overstated, doubly for older claims, but Nigel Richards memorized a French dictionary in 9 weeks, over 6k words a day, x2 including the alphagram.
I consider myself to have a decent memory, but that is 200x what I'd think myself capable of, assuming I want to retain it all at the end of the 9 weeks.
Our brain consists of approximately 86 billions quantum computers [2] controlling tens-of-thousands chemical neural networks with at least 10 coefficients
By that logic, a Blackwell GPU contains 208 billion quantum computers.
Each transistor is a quantum mechanical system and takes hundreds of model parameters to describe. So apparently a GPU is a 208-billion-node quantum supercomputer.
"The brain is not a computer" != "Parts / aspects of the brain do computation".
"A computer" in the first statement is IMO obviously intended in the common usage sense of the term, i.e. the brain is not a desktop computer or smartphone, or Turing machine, or etc, and thinking of it like these things will cause more error than insights. Also, billions of interlinked mini bio quantum computers arguably produce something with emergent properties and behaviour much, much more complex than "a computer". I am with GP, the analogy to "a computer" is not super helpful here unless you highly restrict the meaning.
But yeah, the Shereshevsky case is a super interesting one, thanks for linking!
2 replies →
The book Moonwalking with Einstein covers Patient S and memory in general. It's an enjoyable and quick read on the topic, would definitely recommend.
I see it differently: as a teen, I could remember the exact word for lots of things, I could recall numbers and data with high precision. Nowadays, I'm pretty bad at all those things, but I can very well understand metaphors and connects concepts from wildly different topics — which I couldn't back then.
I see this kind of "interconnecting ideas" of my current years as somewhat connected with "fuzzy memory". It's like, when I retrieve data, it's not as precise, and sometimes I get neighbouring data, but that can actually of use.
I feel like I feel this increasingly as I age. I used to be able to remember nuanced details of API and computer systems. Now, so many of those memories simply get stored as “FLAG: double check the docs” (because I’ll forget).
I’m a lot better at assessing things from a high level, knowing where to find the information I need, and knowing how to assess it for accuracy - but I can’t remember details anymore. Books become summaries. Trips become a few key snapshots representing the trip.
I am not a biologist so I cannot say this authoritatively, but I’m fairly certain that’s not how neuroplasticity works.
I only mentioned neural assemblies storing multiple embeddings - what about that contradicts your understanding of neuroplasticity?
How so?
I don't think there is a "full" state, but watching the changes as the years go by I have thought of collisions. Not really like a hash table, though--most collisions are with things that would be filed together. I think it's more like the brain returns a random item matching the category. Brains are expensive, memory that gets fuzzy with age is probably the better choice than trying to feed a brain that does better.
Yes, evolution is not going to penalize everyone with a "100-year brain" when the rest of our body seems optimized for something more like a 30-40 year lifespan. Evolution is all about propagating your genes, and not too many 100-year olds are going to be doing that!
In any case, fuzzy associative recall is really the "design spec" for a brain, so semi-graceful degradation and fuzzy recall comes for free.
I'm not sure if old-age memory unreliability is totally random - I would not expect it to be. I'd expect these associative recall failures to happen when there are too many memories partially matching the same "key" (activation pattern), which presumably happens mostly when they do have something in common.
Is it aging or the extra amount of information on the brain? If a young man is in a coma and wakes up as an old man will he experience the blend memories or will he remember things just as they were when he remembered them as a young man?
There's also the issue of the more we remember something the more we change it. Which could contribute to the blended memories.
i had the same thought about to much information in the brain. this is why you don't use /compact and should prefer a fresh session.
The paper certainly has its limitations. Only 61 participants, with almost nobody between 30 and 50, so we shouldn’t read the age trend as a decline across lifespan. What’s more interesting than the title suggests (and I find the title forcing the conclusion a bit) is that the attention measures were not linked to age or the brain patterns at all.
Then again, i'm 45 and I've been losing my keys and my IDs since I was 20
>I find the title forcing the conclusion a bit
The entire article is AI-generated.I wish such sources would include the prompting used as well as the model so a (human) reader can better evaluate the document.
> Reviewed by Patrisha Antonaros
There is a responsible signer.
If you think their method can be improved, write at https://studyfinds.com/contact/
They disclose an "AI policy" - https://studyfinds.com/ai-policy/
> This process includes multiple checks using different LLM platforms, human editorial verification, and cross-referencing with original sources to ensure accuracy and eliminate false information, misleading content, fabricated content, bias, and unreasonable speculations or editorialization
The concept of memories blending together resonates after watching a recent Kurzgezadt video entitled "How Are Memories Stored Inside Your Brain?". It makes the point that the very act of recalling a memory changes it:
https://www.youtube.com/watch?v=PqtggjVAi8M
> But memories are not static like photos. Like dioramas made from wax, each time they’re under the spotlight of your attention they can melt and change a tiny bit.
I suspect my oldest memory, of me getting into a booster car seat as a child, is no longer the actual memory, but the accumulated imaginings of me trying to remember that specific memory, masquerading as a memory.
Comet Hale-Bopp is definitely a case of this for me. Although I remember a few interesting things about the process of seeing it, I have no idea of what it looked like to me.
I can remember the neighbors standing slightly in our yard and then explaining to my parents the comet and pointing it out to us. I can remember at some points that followed being aware of the parallax effect as it seemed to appear on either side of my other neighbors’ house as I walked up and down the driveway.
But just a year or so later, I knew that the picture in my memory was more like an illustration of a comet. The accurate image was completely gone even though the memories surrounding it remained, and in the place of that image was something that I had imagined.
My earliest memory… turned out to be a videoclip I discovered 20 years later… I really thought I experienced this!
Very poetic metaphor!
Gonna chuck a thought for you all. In social situations there is someone who talks alot and I think they are able to do so because they have lots of stories they can recall in good detail (maybe not perfect) but 20 year old event they are describing better than I can describe last week. Now I assume they don't have that rare calendar level memory but they do have a huge storage of stories and events. I am pretty jealous tbh!
Also that skill is probably excellent for interviews which is the ultimate memory test. I.e. Tell me a time when you turned water to wine, plus 5 deeper questions, any hesitation will be chalked ip as suspicious AI use.
For me I either do or I remember which makes performance management and interviews hard for me (as someone vouching for someone as evidence is rare now).
It's interesting for interviews. I assume that people who have somewhat inaccurate memories but with a (possibly subconscious) egotistical filter do much better in interviews than those of us who have more accurate memories of exactly what our contributions to a project were. There are a lot of ways of stretching the truth in your favor, and they all seem much more natural if you really believe them.
My friend recently told me about seeing that an old coworker of hers from 20 years ago described her role as HR manager rather than HR assistant on her LinkedIn. I can easily see how someone with a fallible memory can retroactively exaggerate their title or responsibilities, especially when it's been 20 years.
I have a few friends and family members like that and for the stories which I was present, they always hit the broad strokes, but the finer details get switched around and sometimes the whole story has a major perspective shift.
My theory behind this is that when you encounter something new/novel it is distinct enough to remember -- where you were when you learned of 9/11; the days around the start of covid/lockdowns; being in a car accident; getting married; etc..
However, when you experience the same thing repetitively -- having breakfast; getting ready for school/work/etc. -- it doesn't make sense for your brain to remember each of these events as distinct events but to mush them together into a single or combined memory. This may be due to how the brain indexes/references memories and that memories with the same references get combined together.
This is also partly why time appears to go faster when you get older -- the same day-to-day events blend together but the key milestones (holidays, etc.) stick out.
We do know that memories get rewritten every time they are remembered
By 'rewritten' do you mean refreshed, like learning material with spaced repetition, or some different/deeper concept? Do we 'move' that information to a different cluster of neurons?
Compacting ———-~~~~~~~ 40%
Retrocompomorphism
Deticulating splines...
This comes as absolutely no surprise to me -- my mother was recently transferred into memory care, and the changes to her memories are definitely showing some interesting changes. The foremost was that her new "apartment" is shared with one other person, gives off a bit of a dorm room vibe. First day, she was talking about how excited she was to be going back to school and seeing her boyfriends again(?!). I said, "Oh, like Doug? [my dad]". Her response? "Ew. No."
But, she's come around on that, and recently been upset about the affair he's been having (they divorced in 1980), and is irate over him having another kid with his new wife (1983), but isn't surprised that I haven't spoken to him in 12 years. She's never surprised at how I've aged, but doesn't remember her grandkids even exist and insists on meeting them soon (but remembers them when she sees them). Two weeks ago, she called to yell at me for things I did in high school (1990). At this point, I seem to be the anchor for everything recent, but when I'm not around physically, it's scattered everywhere else.
It's hard to write this, but before my grandmother died about 45 years ago, it felt like she'd lost almost all her memories, but was easy to take care of. She was in her late 80's.
My mom & aunt took yearly turns keeping her in their homes. If you kept her away from the stove, she still seemed quite happy helping fix her own breakfast, taking her meds, etc. Give her a warm washrag after, and she'd wipe down the table and then proceed to putter all around the kitchen, wiping and straightening. She preferred cartoons on TV (easier to see, I guess), and was always glad to fold clean towels or clothes, if she had the chance.
Once, she actually recognized me, and remembered my name. It was a very precious 5 minute chat, but then the memories were gone. Still, I'll always remember her that way, because it was just like how I remembered her, when I was a child.
Man, that makes me happy. I'm guessing your grandmother was a very upbeat, happy person who dealt with change well. My mother's the opposite, so now every little thing going wrong is the end of the world. It's rough, but I also get to see these moments where I can see how she was when I was little/before I was born, and those are moments that I do really enjoy.
1 reply →
I feel for you. Even though it's entertaining to read, that must be really hard to go through for you.
Sorry to hear that - my dad spent the last few years of his life in a care home, and I can very much relate.
Is so fascinating and horrifying to read this. We still have to learn so much about how the brain works
My dreams imprint stronger than reality. This has the unfortunate effect of sometimes recalling memories as real, when in fact it was all a dream.
Unless the dreams are the reality and the reality is the fake!
The new version of this tale is that reality is a simulation. Reality being a dream is so 4th Century China
That’s also what happens at around ~1200 micrograms
Happened to me, induced chemically when I experimented with lucid dreaming. It was to scary so I stopped it.
I have some memories that I know for a fact are wrong in a pretty particular way. They’ve either become attached to the wrong place or the wrong time.
Like I remember a good friend picking me up from my childhood home, yet I didn’t even know that person until I’d long moved out (many years) from that place.
For those getting locked out due to using an ad blocker: https://archive.ph/rPdSW
And the actual study: https://academic.oup.com/cercor/article/36/7/bhag114/8758582
How much of this, I wonder, is a function of the fact that our circadian rhythms get less robust with aging. The circadian clock hugely influences learning and memory processes, gating when you can learn and how much, and shaping the storage and recall also.
We know that with age the amplitude of these rhythms can decrease, as can the synchrony between cells.
This kind of mid-management seems to have at least some circadian component, and it would have been great if they looked to see if the effects were equally bad at all times of day, and knew the chronotype of the participants to use as a reference. I’d love to see if every test participant was tested at their cognitive peak, too.
Anecdatum: I confidently told a woman that her son, who was looking for a research opportunity in Berne, Switzerland, was heading for the birthplace of the World Wide Web, which is actually a couple of hours west and south at CERN.
I can't wait to tell my dad about this study. We recently got into a heated debate when he insisted that I was a toddler on a family vacation we were reminiscing about, when in fact I was a teenager on that particular vacation, and he was mashing it together with memories of a different vacation. He is 75 but is in pretty good cognitive health, no signs of dementia besides this unreliable long term memory.
I feel that anyone who has cared for someone with progressive brain degeneration has seen this a million times.
My grandmother has dementia, and if you know her you can see exactly which events/memories she's erroneously combining.
Worth keeping in mind also is that memories are not a reliable facsimile of objective reality.
Instead, they are selective representations of parts of a subjective experience. It also means that memories aren’t static, but shift over time and can even be imagined.
I feel like we didn't need a study to tell us this but its always nice when science confirms something we know to be true.
Clearly the hash table is filling up so you get more hash collisions.
This I belive, I used to have intimate knowledge of my niche internet lore and keep learning I am blending years around.
As a person who used to be a super genius then turned 40 and is now only a regular genius aging has been very hard to get used to.
Don’t worry. By 60 you’ll remember being a super genius again — with increasingly convincing evidence.
I think at 60 the definition for super genius just changes to "having regular poops".
It's interesting to compare and contrast LLMs and biological brains. Both use a form of "compaction".
Compaction is not even an intrinsic function of an LLM, but of it's harness or whatever code is calling it. When an LLM compacts something it's just creating a summary of the previous conversation using the same mechanism that it uses to generate any other text. It doesn't "forget" the text from before the summary, it just no longer receives it when it is invoked.
In contrast, when we forget something we are not summarizing anything, we are just losing the ability to recall something. We might remember what we have forgotten later on, showing that it is still somewhere in the mind, and that the reason we have forgotten it is not necessarily because it has been discarded.
Even then, what this article is talking about is not even normal forgetting as a function of the brain. It's talking about a degenerative and dysfunctional form of memory loss where different memories are confused with each other.
That's largely because we intentionally model llm "brains" after the human brain.
Huffman Coding! :-)
Things seen at a distance blend together, as opposed to just disappearing.
So that's an interesting parallel. Says something about memory.
the basins merge
FYI this is LLM slop. Consider the information to be entirely unfounded.
What, the paper from Mekbib and McDonough, or the divulgation from Antonaros?
Supposing it is the submitted (under Antonaros), see https://news.ycombinator.com/item?id=49538906
/compact
[flagged]
Evidence?
Sounds like something from https://sebpearce.com/bullshit/
It's an LLM bot user.
1 reply →
their username is enragebait
[dead]
This a covert op to buttress LLM support by planting this article and having people say it's just like compacting. The hype is getting more elaborate.