← Back to context

Comment by altruios

2 hours ago

> "...I am a computer program that generates responses to your prompts based on what my training data tells me is most likely to be correct and sensible."

This is correct only for a toy mental model of what an llm is capable of.

However it gets murky once you realize that (on a per token level) the llm is capable of changing it's temperature (rng %'s on picking the next token) top_k/top_p (how many options are shown per token). Adding in that bit of control to it's own output muddies that statement, as this, in effect, renders a 'mood'/'mode' in the LLM's response. so 'correct and sensible' are no longer the correct adjectives (well... unless you consider the 'me' in that statement to be a 'reasoning agent'... the fact is we don't have good words to work with here), but 'realistic / agentic' might be more in tune.