Comment by Havoc

> long running

I really dislike this as a measure. A LLM on CPU is also long running cause it’s slow.

I get what it’s meant to convey but time is such a terrible measure of anything if tk/s isn’t static