Comment by sosuke

Doing something novel is incredibly difficult through LLM work alone. Dreaming, hallucinating, might eventually make novel possible but it has to be backed up be rock solid base work. We aren't there yet.

The working memory it holds is still extremely small compared to what we would need for regular open ended tasks.

Yes there are outliers and I'm not being specific enough but I can't type that much right now.