Comment by hrn_frs

18 days ago

Any attempt at world modeling using today's LLMs needs to have a goal function for the LLM to optimize. The LLM needs to build, evaluate and update it's model of the world. Personally, the main obstacle I found is in updating the model: Data can be large and I think that LLMs aren't good at finding correlations.

3 comments

hrn_frs

Reply
ethbr1  18 days ago

Isn't that just RL with extra power-intensive steps? (An entire model chugging away in the goal function)

  • hrn_frs  17 days ago

    That's correct, but if successful you'd essentially have updated the LLM's knowledge and capabilities "on the fly".

    • ethbr1  17 days ago

      Maybe we could run off-peak load of that nature, when power is cheaper. Call it dreaming. ;)