Comment by tracerbulletx
10 hours ago
I think this is pretty well established as far as neurologists are concerned and explains a lot of things. Like dreaming for instance.. just something like the model running without sensory input constraining it.
Always wondered if dreaming is some kind of daily memory consolidation function. Logged short-term/episodic memory being filtered and the important bits baked by replaying in a limited simulacrum.
There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
That's the wake sleep algorithm for undirected graphical models.
Hinton had a course on Coursera around 2015 that covered a lot of pre NN deep learning. Sadly I don't think it's up anymore.
1 reply →
Could you please give some sources - books or articles or videos on that topic? It's really fascinating
https://onlinelibrary.wiley.com/doi/abs/10.1111/phib.12268?u...
https://pubmed.ncbi.nlm.nih.gov/23663408/
https://royalsocietypublishing.org/rstb/article/371/1708/201...
https://pubmed.ncbi.nlm.nih.gov/20068583/
I'll also recommend Being You by Seth Anil. It makes a lot of sense of consciousness to me. It certainly doesn't answer the question but it's not just throw your hands up and "we have no idea why qualia", and it's also not just "here's a list of neural correlates of consciousness and we won't even discuss qualia".
It goes through how sensations fit into this highly constrained, highly functional hallucination that models the outside world as a sort of bayesian prediction about the world as they relate to your concerns and capabilities as a human, and then it has a very interesting discussion about emotions as they relate to inner bodily sensations.
the book I mentioned (_The Experience Machine_ by Andy Clark) talks about this.
https://slatestarcodex.com/2017/09/05/book-review-surfing-un...