Comment by villish

Thats only important if running it locally is critical for privacy reasons or just as a hobby.

Time has a cost in business. If a model needs 30 million tokens to achieve a similar result as another that can do it in 10 million, that 60 tokens per second will take a long time.