Comment by guywithahat
17 hours ago
> At the bot’s suggestion, she reduced the daily intake of immunosuppressant medication her doctor prescribed her and started drinking green tea extract. She was enthusiastic about the chatbot
I don't know enough about medicine to say whether or not this is correct, but it sounds suspect. I wouldn't be surprised if chatbots, in an effort to make people happy, start recommending more and more nonsense natural remedies as time goes on. AI is great for injuries and illnesses, but I wonder if this is just the answer she wants, and not the best answer.
As soon as the model detects user pleasure at not needing a scary surgery (especially if you already confided that you're scared) then it'll double down on that line to please the user.
med student here: Reducing immunosuppressant not something to be taken lightly for kidney transplant patients. I was shocked when I read that sentence.