← Back to context

Comment by yjftsjthsd-h

3 hours ago

Wait, how did it `sleep 3`? I thought LLMs didn't have a concept of time

It’s still rendering frames constantly, no? So it just figures the next X frames are all doing nothing?

  • Normal only keypresses invoke the next ”frame”. There is a sleep token that the runner could use to indicate that time is moving.

from the post:

Time is an input too. If nothing is pressed, the model gets a WAIT token with a duration instead of a key, which is how snake keeps moving on its own.

  • That seems as likely as anything, but that just moves the problem to counting, doesn't it? The model gets the duration, but I was under the impression LLMs struggled with the arithmetic that would make that useful.

    • Idk about Qwen 2.5 Coder that this is based on, but modern models don't struggle with arithmetic. I see Qwen 3.8 do long-hand math in thinking traces (ie. it outputs 17+35+12=64 in the thinking trace) so I would imagine this is something they train into the model specifically. Sometimes it creates and runs a simple python script to check its work.

      2 replies →