Comment by astrange

Since LLMs are loosely based on NM models, it seems research on newer sampling methods like Mirostat might help here.