← Back to context

Comment by benswerd

15 hours ago

I predict LLMs will reach superhuman level and beat even that model in the next 12 months

Starcraft is APM-dependent. Unless the latency will improve greatly in frontier reasoning LLMs (which is unlikely), it will remain a bit like knitting with an excavator.

  • I predict latency will improve greatly in the next 12 months to more than 4x speed on current frontier tasks

    • The best sc2 bots these days play in the ~50,000 APM range (they could mostly go higher as well, but the game client breaks somewhere around 100k APM). I don't see an LLM-based bot getting up to that sort of speed anytime soon.

      On the other hand, I do think LLM-based bots will quickly outperform the decision-making of many of the hand-coded bots, so maybe they won't need so much APM to be competitive.