← Back to context

Comment by GrinningFool

8 hours ago

Using llama.cpp I one-shotted (2 hours) a reasonable asteroids clone on my strix halo/128 using the 1 bit quant, using my custom harness (which isn't anything exceptional).

It was tedious - a lot of second guessing itself, and quadruple checking things it fixed a couple of iterations back - but it got there and the result is a playable game.

Speed starts out strong, but definitely drops off as context grows. At the end (I think context about 70k) it was down to 12 output tps.

Mind a bit blown.