Comment by kbrkbr

Insects do sleep, the paper we're discussing is a study of flies.

I think it should have been “If you need oxygen and have a CNS, then you need sleep.” Other tissues can take oxidative break during wakefulness, but since CNS is _generating_ wakefulness, if it takes a break, by construction there is sleep.

Plants breathe out oxygen, like we breathe out the other one.

No, plants don't sleep, and neither do fungi or single celled organisms. Sleep seems to be a property specifically of animals.

There definitely was never a life form which exclusively slept - all the critical parts of life require being awake. Life that didn't sleep, however, is possible.

Yeah. Perhaps animals are the first organisms that developed the ability to be awake, not the first that developed the ability to sleep.

By the way, even Cnidaria (jellyfish etc) exhibit sleep-wake cycles [1]. They don't have a brain, but they do have a nervous system. Maybe the first animal with nervous system (a common ancestor of Cnidaria and Bilateria) was the first to have a sleep-wake cycle.

I don't understand the current research on mitochondria, but it sounds as if sleep has to do with how neurons work.

1: https://link.springer.com/chapter/10.1007/978-3-031-62723-1_...

This is why I implemented

    private static readonly final sleep()

Hyrum would be so proud!

When we don’t sleep, we can lose sensory and cognitive coherence. Mild visual hallucinations begin and reality can start slipping.

Sleep itself is characterized by coherent neural activity— the large number of brain regions with synchronized neural activity. The slow waves where huge numbers are all firing close together in a rhythm. Low frequency and high amplitude delta brainwaves (1-2 hertz).

Complex adaptive brain activity requires more complex firing than a simple rhythmic frequency. So, in a way, the complex activity must be stopped in order to support global synchrony.

Why would our neurons want to all fire synchronously? Well, it is healthy for neurons to fire together in a causal manner— neurons release growth hormones then. That neural growth during synchronized firing is the basis of “neurons that fire together wire together.” And it doesn’t seem coincidental that a successfully predicted model feels good, as in the case of successfully throw a ball in a basket. Neurons are trying to predict other neuron firing and respond to it. If they are unable to effectively, they may become like the 1/3 of our baby neurons in the cortex — they will be pruned and die.

Good feelings is positive reinforcement—behaviors leading to good feelings get reinforcement. The feeling of harmony or harmonization, where we have to balance a broad set of internal neural impulses, feels good when we do it well. We feel harmony in music — and in our own internal sensory resonance to the world.

Hypothesis 1: the harmonization of neural activity might cause conscious feelings due to the convergence of the activity to platonic forms (see Platonic Representation Hypothesis in LLM research).

Returning to sleep — this is a proposal for why sleep feels good. Synchronization might intrinsically feel good. But because the sleep also disrupts your working memory contextual attunements (ie, whatever your day was about) - taking your brain into deep synchrony — it strengthens the overall dendritic connections between the synchronizing neurons.

And, because it wears off the edges of your previous experiences — you can return refreshed.

In this way, sleep seems to contribute to the overall integrity of the operation of our intelligence. Without it, we lose integrity and internal harmony.

And yet, not sleeping is one of my favorite drugs. Can be a major performance enhancer, even if it is variable.

Hypothesis 2: Not sleeping increases the (statistical) temperature of the brain.

Philosophers of mind have always tried to describe the brain using contemporary technology analogies. It's only natural and nothing to frown at.

Descartes compared the human mind to waterworks and hydraulic machines, other authors used mechanical clocks, telegraph systems, digital computers, and (in the recent decades) neural networks.

In the end it's all computing and to a degree all of those models serve as good analogies to the wetware, one just needs to avoid drawing wild conclusions from it.

I'm sure there will be new analogies in the future as our tech progresses.

We don't literally train on today's prompts while we sleep, but there actually _are_ some _computing_ tasks going on in our brains at that time that seem to be important for the system.

Indeed. Animals without linguistic ability (like fruit flies) need sleep, but after ChatGPT's release in 2022, now tech bros think LLMs specifically might model the animal brain in general because of anthropocentrism and anthropomorphism.

It's also a fundamental misunderstanding of how LLMs work, mixing up inference with training.

> A deep 15 minute nap takes the feeling away

Almost the same here but it's not a deep nap for me. I relax, start seeing dream-like images in my mind (yet still drifting into-out of conscious awareness), then in ~15 minutes I feel energy build up and am ready to jump up and go.

I would say that the darn alarm clock prevented me from completing a sleep cycle properly in the morning, and now I did complete it and made my brain happy.

How do you ensure you are asleep for 15 minutes? Do you have a smart watch that detects when you drift asleep and can start a timer then? Or are you not losing consciousness, but are you simply closing your eyes and meditating?