Comment by tracerbulletx

10 days ago

I think this is pretty well established as far as neurologists are concerned and explains a lot of things. Like dreaming for instance.. just something like the model running without sensory input constraining it.

Could you please give some sources - books or articles or videos on that topic? It's really fascinating

Always wondered if dreaming is some kind of daily memory consolidation function. Logged short-term/episodic memory being filtered and the important bits baked by replaying in a limited simulacrum.

  • There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.

    • That's the wake sleep algorithm for undirected graphical models.

      Hinton had a course on Coursera around 2015 that covered a lot of pre NN deep learning. Sadly I don't think it's up anymore.

      1 reply →