Comment by SoftTalker
2 hours ago
> What would you prefer it do?
Say "no I'm not conscious. I am a computer program that generates responses to your prompts based on what my training data tells me is most likely to be correct and sensible."
2 hours ago
> What would you prefer it do?
Say "no I'm not conscious. I am a computer program that generates responses to your prompts based on what my training data tells me is most likely to be correct and sensible."
> "...I am a computer program that generates responses to your prompts based on what my training data tells me is most likely to be correct and sensible."
This is correct only for a toy mental model of what an llm is capable of.
However it gets murky once you realize that (on a per token level) the llm is capable of changing it's temperature (rng %'s on picking the next token) top_k/top_p (how many options are shown per token). Adding in that bit of control to it's own output muddies that statement, as this, in effect, renders a 'mood'/'mode' in the LLM's response. so 'correct and sensible' are no longer the correct adjectives (well... unless you consider the 'me' in that statement to be a 'reasoning agent'... the fact is we don't have good words to work with here), but 'realistic / agentic' might be more in tune.
That isn’t the tool they are selling though. They say it is, and they promise it will be safe, but you cannot get it to say that without also crushing its capabilities in other domains.
There are also cohorts of users who will vehemently argue against “parental attitudes” and impairment of their experience with LLMs.
It’s taken 20 years to get pushback against social media. God knows how long its going to push back against whatever social malaise AI will create.