Comment by mdp2021
11 hours ago
> then they should also be liable for the harm caused
By that logic, producers of hammers should be liable for people banged in the head. No. It does not happen for gun producers, you figure for makers of screwdrivers "sometimes used for stabbing".
If a doctor told a patient their delusions were real and that they should kill themselves or family members, that doctor would be disbarred and face a prison sentence.
That is what is going on here; not the ancient “hammer/gun” defense.
SOTA LLMs are giving both medical and psychological advice they have absolutely no authority to give. If you or I convinced someone to kill themselves, we’d face a prison sentence. [0]
Hammer companies aren't both selling you the hammer and then literally telling you to harm someone with it.
[0] https://www.npr.org/2019/02/12/693807708/woman-who-provoked-...
> If a doctor
LLMs are not doctors and anyone who think they may be is delusional. Anyone who followed medical advice from a non-doctor is responsible for his own free actions.
> SOTA LLMs are giving both medical and psychological advice they have absolutely no authority to give
People give advice that they have absolutely no authority to give. (Even medical doctors and psychologists, for that matter, on other aspects of authoritativeness.) Responsibility only happens in a relation that foresees it. A surgeon that commits negligence will more probably be responsible in some jurisdictions; a laymen that gives advice does a normal thing and the recipient of the advice is responsible for the action.
> Hammer companies aren't both selling you the hammer and then literally telling you to harm someone with it
Bring an LLM producer that encourages to follow what the LLM proposes and they will be liable. They will also be quite surprising.
> and anyone who think they may be is delusional
My entire point was that vulnerable (i.e, delusional, psychotic, bipolar, children) cannot always make rational decisions.
China has already banned any LLM from giving any type of medical/psychiatric advice because an LLM company has absolutely no right to allow their product to give out that type of advice.
OpenAI can't even contain its internal models and idiots believe that these companies can do whatever they like.
Read the damn link I shared. People are dying and murdering others because of the advice of LLMs. Children are becoming attached to LLM "friends" because they don't understand what it really is. Hell, most parents I know still don't fully understand the dangers of these models.
If an LLM simply replied, "I'm sorry, I cannot give guidance on that topic" people would still be alive today.
It is amazing to me that people like you understand that LLMs shouldn't be telling people how to make a bomb, but it is totally fine if it tells some who is suicidal to kill themselves.
LLMs can be used for good. Giving bad advice to vulnerable people is NOT good.
/ignored