Comment by svachalek

It's not really all that fast, for most things it's full seconds or at least a significant portion of a second. As computing goes that's quite slow and there are many things that require much faster speeds than this. However compared to the typical LLM it's quite speedy and opens some new doors for real-time-ish scenarios.