← Back to context

Comment by xnx

4 hours ago

Reminds me of Google's AI Dreamer that could mine diamonds in Minecraft (https://www.scientificamerican.com/article/google-deepmind-t...) or OpenAI training on video to play Minecraft (https://openai.com/index/vpt/)

2 comments

xnx

Reply
agajews  4 hours ago

Very much inspired by those papers! One of the things that's interesting about our model is it's goal-conditioned, so it can do any task at inference time without training on it. We had a lot of fun making eval environments after we trained the model trying to find interesting things it can do, and that was all after we trained the model. More like prompting an LLM.

(Versus Dreamer, which needs to be trained on a hand-written reward function for each task that you want to do.)