← Back to context

Comment by lwhi

3 days ago

This leads me to wonder, when are we likely to have LLMs in robot form in every day life?

You could build one today! Lots of hard problems around a proper humanoid form, but if you're cool with wheels it would be pretty easy to hook up a little robot to GPT.

Look up VLA models; that's essentially plugging the guts of a language model into a transformer that handles joint motion/vision. They get trained on "episodes" i.e. videos from the PoV of a robot doing a task, after training you can ask the model things like: "pick up the red ball and put it into the green cup" etc. Really cool stuff.