Comment by ansipunk

7 hours ago

It is impressive, but it is also a display that LLMs are simply not suited for this, there's way too much latency. Obviously, a more specialized neural network would be much better, but would you believe this:

In 2017, OpenAI presented the first version of their program that plays Dota 2, a very complex, fast MOBA with endless mechanics and defeated one of the world champions in a one-on-one match. Next year, they showed the world OpenAI Five, a version of the program, that runs a full five player team of those bots and they managed to defeat a full team of world champions in 2019. They ran an event where the bots would play for 4 days straight and they won 99.4% of 42,729 matches.

https://en.wikipedia.org/wiki/OpenAI_Five

> They ran an event where the bots would play for 4 days straight and they won 99.4% of 42,729 matches.

Of course they also flat out disabled any mechanic their AI hadn't mastered.

  • I don’t think they did. If I remember correctly, the only limitation they have introduced was the available playable character pool.

    • Moreover, in their private training sessions, their models played cumulatively about 180 years worth of games, so I doubt there were many mechanics left to be mastered.

What some people do on the rs-sdk runescape server is Jev + deterministic scripts + orchestrating with Astra

And CNN for image recognition? It’s (similar to) what the human brain uses.

  • No image recognition, the bot gathers info about the game from Dota's developer API. Which, to be fair, is a massive advantage, but it, in my opinion, doesn't make the achievement any less.

but that is not LLM (Transformer), its LSTM

  • That's what I said in my comment, that LLM is just not what you want for such a task.

    • depends, for mindustry yes.

      But if you look at minecraft interacting with other Humans in an Environment where there is no winning requires some part that is capable of natural Language.

      Also it is more an interesting way to see how different architectures behave