Comment by Der_Einzige

Daily reminder that none of these numbers are valid in a world where no one publishes the sampling settings used.

Daily reminder that improving your samplers from the garbage default top_p/top_k to min_p or subsequent methods dramatically improves the performance of these models, and makes most quantities like measured "verbosity" and subsequent calculations of "intelligence per token" meaningless

Daily reminder that no one, including within academic AI research, AI engineers, normies, etc takes LLM sampling seriously enough.