Comment by qeternity

6 months ago

It also appears that this was a sampling benchmark...which is not representative.

Generation benchmark was 5% faster than SGLang.