Comment by swalsh

I've had this thought that the next generation of AI isn't a long "training" period, but rather it probably makes sense to to train a barebones version, and to give it a "sleep cycle". During this time it could use the context (think of it as short term memory) and then fine tune the parent model with it turning the important stuff into long term "memories", with probably a pruning type mechanism for rarely used stuff to keep the important stuff a priority. Would turn AI into individuals with specialized knowledge, but maybe that's more useful even? Like I don't need an AI with an expertise in law, I just want to use it to automate this specialized business process I have which isn't easily automated.