Comment by root_axis
2 days ago
Still, the statement that LLMs are non-deterministic is incorrect and could mislead some people who simply aren't familiar with how they work.
Better phrasing would be something like "It's worth noting that LLM products are typically operated in a manner that produces non-deterministic output for the user"
> It's worth noting that LLM products are typically operated in a manner that produces non-deterministic output for the user
Or you could abbreviate this by saying “LLMs are non-deterministic.” Yes, it requires some shared context with the audience to interpret correctly, but so does every text.
Simon would be less engaging if he caveated every generalisation in that way. It’s one of the main reasons academic writing is often tedious to read.