Comment by Der_Einzige

Most of them don't expose more than top_p/top_k/temperature. Those are woefully inadequate compared to what open source inference engines support.