ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this.
I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life.
(One example, if you are curious: I've been doing rehab for a back injury for about 10 years. I worked with a certified trainer/rehab professional for many years and built a program to keep me as pain-free as possible. I rebuilt the entire thing with ChatGPT/Gemini about 6 weeks ago, and I've had less pain than at any other point in my life. I spent at least 12 hours working with AI to test and research every exercise, and I've got some knowledge to help guide me, but I was amazed by how far it has come in 12 months. I ran the results by a trainer to double-check it was well thought out.)
This sounds like excellent evidentiary material for a future insurer or government health provider to decide you're uninsurable, not eligible for a job, and so on.
And the great thing about it is that you already signed all your rights away for them to do this exact thing, when we could have had an open world with open models run locally instead where you got to keep your private health information private.
> when we could have had an open world with open models run locally instead where you got to keep your private health information private
But we can have that? If you have powerful enough hardware you can do it, right now. At very least until the anti-AI people get their way and either make the models' creators liable for what the models say or get rid of the "training is fair use" thing everyone depends on, in which case, sure, you'll have to kiss legal open-weight models goodbye.
If the person can use AI to lead a noticeably better life, something that may have been impossible previously due to economic circumstance, then the first order benefits outweigh the second order drawbacks.
I’m not disputing what you’re saying, I just think that treating it like a zero sum game every time the conversation comes up is showing an immense amount of privilege.
You, me, the parent commenter; we’re all dying, we don’t have time to optimise for the best outcome.
What do you consider the purpose of life to be? To me being in good health is immensely more important than health insurance, a government health plan, or a job.
I know that neither health insurers nor any government agency nor anybody else have even 0,0000000000000001% as much interest in my health, well being and survival as I do.
When it is the matter of my health and my life, I care as much about what an insurer or employer thinks as I would care about what the Ayatollah of Iran thinks. Or what you think. Ie: Those opinions are without any value at all.
I've had a similar positive experience and I'm really surprised at the cynicism here. You have a system that is good at reading tons of literature and synthesizing it, which then applies basic logic. What exactly do the cynics think that doctors do?
I don't use LLMs as the final say, but I do find them pretty useful as a positive filter / quick gut check.
They agree with you. Almost all the time. If you ask an AI whether you have in fact been infected by a werewolf bite, they're going to try and find a way to say yes.
I also think health (and car-problem diagnosis) are excellent tasks for LLMs.
The you-are-the-product thing, and privacy, has me wondering when Apple will step in and provide LLM health in a way we can trust.
I know I say that and I face the slings and arrows of those distrusting Apple, but I still believe they're the one big company out there that knows that there is money in being the one guy that doesn't sell your data.
I don't think one can deny the benefits here. The detractors here are like don't build a side walk coz someone may trip and fall or don't plant trees in your front yard coz of what happened to the Texas governor.
Most would likely agree that everything needs a balanced approach, bashing a service completely as evil and fully advocating people to stay away vs claiming the service is flawless (which the OP isn't doing btw) aren't either a balanced position.
Think different doesn't have to mean think extreme.
You could also list plenty of horror stories where people went to medical professionals and got screwed over. There is this myth that people can go to doctors and get perfect attention and treatment. Reality is far from that
"…a 60-year-old man who had a “history of studying nutrition in college” decided to try a health experiment: He would eliminate all chlorine from his diet…"
You can see already that this can easily go sideways. This guy is already exploring the nether regions of self-medication.
It would be ideal if LLMs recognized this and would not happily offer up bromine as a substitute for chlorine, but I suspect this guy would have greedily looked for other shady advice if LLMs had never existed.
No, there's a difference between radically changing your diet and changing up your stretch/strength routine.. you don't just "end up" like one of them, you can evaluate that the downside risk of the latter is much lower and try it safely while recognizing that an extreme diet might not be so safe to try without any professional guidance.
If you'd been doing the rehab for 10 years, what did you need exactly? It seems like you should have had a decade to ask whatever questions you wanted.
That was a specific example where AI helped me revamp my workout. No workout stays static; it has evolved over the years, in small ways. With this change I threw out 60% of it, and replaced it with a lot of work to make sure I was working full body and taking into account the injury. I was having more pain in 2025 and was only pain-free around 90% of the time. I wanted to get stronger but also revet everything I was doing to hopefully get out of that pain.
Hope that helps!
You can ask a trainer questions, they are super helpful and taught a lot, but it is still one person, and they don't often sit around at night reading university/research papers on the injury, etc.
It seems like outcomes are probably K-shaped: those who are capable of critical thinking and deciding what type of information should be confirmed by a healthcare professional and what type of information is relatively riskless to consume from ChatGPT should have positive outcomes.
Those who are prone to disinformation and misinterpretation may experience some very negative health outcomes.
I agree with that. The question I suppose is whether an LLM can detect, perhaps by the question itself, if they are dealing with someone (I hate to say it) "stable".
Anyone asking how to commit suicide, as a recent example, should be an obvious red flag. We can get more nuanced from there.
And if it didn't work out and made you worse or, god forbid, the advice caused you to get seriously injured, then what? ChatGPT won't take any responsibility.
I have so many issues with our current health system but an alternative is not an unreliable search tool that takes no responsibility for the information it provides.
You always have to use critical thinking, listen to your body, and get advice from trainers in the trenches. As I mentioned, I did all of those things :)
> And if it didn't work out and made you worse or, god forbid, the advice caused you to get seriously injured, then what? ChatGPT won't take any responsibility.
Realistically in 99% of actual cases where this happens due to human medical advice, the humans too won't take any responsibility.
on a similar vein, I have recurring back issues due to a spinal issue. I gave the issue to ChatGpT and it gave me almost all of the exercise I had been given years ago by a chiropractor. It's nowhere near a replacement for having someone coach me through movements though.
My mother-in-law has been struggling with some health challenges the past couple of months. My wife (her daughter) works in the medical field and has been a great advocate for her mother. This whole time I've also been peppering ChatGPT with questions, and in turn I discuss matters with my wife based on this.
I think it was generally correct in a lot of its assertions, but as time goes on and the situation does it improve, I occasionally revisit my chat and update it with the latest results and findings, and it keeps insisting we're at a turning point and this is exactly what we should expect to be happening.
6 weeks ago, I think its advice was generally spot on, but today it's just sounding more tone-deaf and optimistic. I'd hate to be _relying_ on this as my only source of advice and information.
Totally agree, it can be a bit of an echo chamber. I had an infection post-dental-work. Bing Chat insisted I had swollen lymph nodes from a cold that would resolve on their own, then decided I had a salivary gland infection. After a follow-up with a real-world ENT, it was (probably accurately) diagnosed as a soft-tissue infection that had completely resolved on two rounds of antibiotics. The AI never raised that possibility, whereas the ENT and dentist examined me and reached that conclusion immediately.
I do think AI is great for discussing some health things (like "how should I interpret this report or test result?"), but it's too echo chamber-y and suggestion-prone for accurate diagnosis right now.
That's awesome that it's helped you so much, chronic back pain is awful. Is it possible though, that this could be interpreted as a failure of the trainer to come up with a successful treatment plan for you? "Sudden" relief after 10 years of therapy just because you changed the program seems like they were just having you perform the wrong exercises no?
We have to also understand that the trainer didn't get to spend 12 hours of researching every minutia or do a trial and error study to get to where OP got to.
This doesn't necessarily mean the trainer failed, just that they were constrained by time, which OP wasn't. And I think that is the essence of this tech, when used wisely, I can lead to results like these which you can't get despite having access to the best talent for a limited time. Only the well afforded can afford a full time trainer/therapist.
The trainer was a godsend, got me to ~95% pain-free, and taught me all kinds of things. He is amazing.
But 2025 was maybe down to 90% pain-free, and I want to get stronger. So I did a big rewrite of my entire workout plan and checked everything. AI wasn't perfect, but it was amazing when you already know some.
It is still a tool I had to direct, and it took a few days of work. But I'm amazed at where it got me to. It took the injury into consideration and my main sport, and built around that. In the past I tried do this online and couldn't do it given the numerous factors involved. It was not perfect, but over the course of a few days, I was able to sort it out (and test with a trainer on the approach a few weeks after).
I've been 100% pain free for 6 weeks in a way I haven't felt in a long time.
Like anything, it is a tool; someone using WebMD badly, and someone can use it well.
I have found it helpful as I can ask ChatGPT questions, teach myself about what I am dealing with, and understand it better so I can ask my doctor questions. I still verify a lot, I still read articles on verified medical sites, etc., but it helps me do that a lot quicker, and I seem to learn quicker.
I'm sure someone can also go deep into anxiety with it as well if they approach it that way. It isn't a miracle button, but it is an AMAZING tool IME.
I agree. LLMs cannot and should not replace professionals but there are huge gaps that can be filled by intro provided and the fact that you can dig deeper into any subject is huge.
This is probably a field that MistralAI could use privacy and GDPR as leverage to build LLMs around that.
One of the big issues I have with LLMs that when you start a prompting session with an easy question it all goes great. It bring up points you might not have considered and appears very knowledgeable. Fact checking at this stage will show the LLM is invariably correct.
Then you start "digging deeper" on a specific sub-topic, and this is where the risk of an incorrect response grows. But it is easy to continue with the assumption the text you are getting is accurate.
This has happened so many times with the computing/programming related topics i usually prompt about, there is no way I would trust a response from an LLM on health related issues I am not already very familiar with.
Given that the LLM will give incorrect information (after lulling people with a false sense of it being accurate), who is going to be responsible for the person that makes themselves worse off by doing self diagnosis, even with a privacy focused service?
I'm lucky to live in Europe now, I cried the first time I went to a doctor here, he chatted with me for 45 minutes. I begged my doctor in the USA to let me book back-to-back sessions, so I could ask him questions and better understand what was going on. He said no; I only had 10 minutes, and he generally didn't have time to answer any questions or provide details. He was a good doc, but just couldn't take the time, and insurance wouldn't comp him for back to back appointments.
This kind of comment scares me because it's an example of people substituring professional advice for an LLM where LLMs are known to hallucinate or otherwise simply make stuff up. I see this all the time when I write queries and get the annoying Gemini AI snippet on a subject I know about and often I'll see the AI make provably and objectively false statements.
You have to use critical thinking + it helps to have some info on the subject + it shouldn't be used to perform self-surgery :)
I spent about 12 hours over 2 days, checking, rechecking, and building out a plan. Then I did 2-hour sessions on YouTube, over several weeks, learning the new exercises with proper form (and that continues as form is hard). Followed by an appointment with a trainer to test my form and review the workout as a hole (which he approved of). No trainer really knows how this injury will manifest, so a lot is also helped because I have 10 years of exp.
This isn't a button click, and now follow the LLM lemming. This is a tool like Google search but better.
I could not have done this before using the web. I would have had to read books and research papers, then try to understand which exercises didn't target x muscle groups heavily, etc. I just couldn't do that. The best case would have been a trainer with the same injury, maybe.
You are exaggerating. LLMs simply don’t hallucinate all that often, especially ChatGPT.
I really hate comments such as yours because anyone who has used ChatGPT in these contexts would know that it is pretty accurate and safe. People also can generally be trusted to identify good from bad advice. They are smart like that.
We should be encouraging thoughtful ChatGPT use instead of showing fake concern at each opportunity.
Your comment and many others just try to signal pessimism as a virtue and has very less bearing on reality.
But I also have to honestly ask myself “aren’t humans also prone to make stuff up” when they feel they need to have an answer, but don’t really?
And yet despite admitting that humans hallucinate and make failures too, I remain uncomfortable with ultimate trust in LLMs.
Perhaps, while LLMs simulate authority well, there is an uncanny valley effect in trusting them, because some of the other aspect of interacting with an authority person are “off”.
How do you know that this understanding is correct? To me, epistemologically, this is not too different from gaining your health knowledge from a homeopath or gaining your physics knowledge from a Flat Earther. You are in no position to discern the validity of your "knowledge".
It isn't a 0 or a 1; it is a spectrum. Doctors don't understand everything, either, which is the scary thing we don't like to realize.
What it specifically helps me to understand are things like: probable outcomes, symptoms in greater detail, as well as how they manifest in patient populations, explains it as if I was a 10/15/20 year old in detail to help me understand the basics of what might be going on, similar things in possible pharma options, general response treatments and pros/cons, etc.
I'm not using this to perform self-surgery or build a belief system :), I'm just trying to learn and understand what is going on at a better level.
It's a lot easier to double-check, cross-reference, or test the validity of advice given by a gpt. It has no authority, no persuasion mechanisms, and its opinions are there in plain text ready to be picked apart. You can ask it for references and non-confrontationally challenge it on the things you're sceptical about. It generally avoids woo in my experience though it's hardly always correct in specific advice, it can definitely point you in productive directions. Which is completely different from discussing anything health with a homeopath, who at best will try to get you to avoid productive treatment and at worst poison you.
> You are in no position to discern the validity of your "knowledge".
He is the only one who is in that position, because he is the only person who is inside his body. He is physically and mentally a hundred percent in the position to discern the validity of the advice.
How is it we have come to a place in society where we second-guess everything we type? But perhaps also where we go (with our "tracking devices" in our pockets…).
I mean, obviously the internet is what changed everything. But it is like you have a megaphone strapped to your face whenever you connect to a site and make a comment.
Sounds like you’re a good little product… abundant potential for shareholder value to be extracted from you and others like you. A trip to the library or a consult with a professional would’ve given you the same or better results.
A phrase I liked to describe what we're doing with LLMs is "building a personal panopticon". The benefits are immense but you're placing a huge bet on the landlord of the tower.
Google did that, Facebook did that and every other company who boasted their user-base numbers did that. They sold user attention and harvested user data. Nothing new here.
If it is genuinely beneficial, this will become an open source project that everyone is able to run with a local agent in their house that runs cold. I will make one if no one else will, but discovering how to make it ubiquitously helpful and not drought with legal liability is challenging. I welcome a company willing to take this early risk.
ChatGPT mostly refuses to talk health issues , while i have found Gemini is reasonably cooperative when asking for things like symptoms and treatments .
This makes me not wanting to try out their new offering.
My dad used ChatGPT to guide him through testing, diagnosis, preparation, and recovery from a quadruple bypass. He never mentioned it refusing to talk about anything, just about how indispensable it was in the process and saved him months of time over skipping it and relying on the medical system alone, without help.
For example, it told him to go out and get a test on his own before meeting with a certain specialist, so the specialist didn’t order it during the first meeting and then need to wait for a follow up after reviewing it. He did this, gave the results to ChatGPT, which sounded the alarm. He sent a message with the results to his doctor and his appointment with the specialist was moved up to the same week, instead of 3 months out.
Is that foreshadowing of ChatGPT redirecting users to ChatGPT Health in some way? Base product no longer answers everything, now I need to pay an add-on fee to talk about health related things?
I doubt it. It's probably a CYA thing. There are a whole bunch of hot-button topics ChatGPT won't talk about, not because OpenAI will ever try to monetize them but because they're fodder for lawsuits.
What sorts of things did it refuse to talk to you about? I've talked with it about my health extensively and uploaded lab reports which it happily interpreted.
it reads the lab report but every one of its answers is prefaced with a refusal. It does provide some information but insists on general answers.
Example phrases it uses: "I can’t give medical advice or tell you what to do based on this report". "I will keep this general and informational, not personalized medical instructions."
Ive had fairly complex health issues and have never had issues with ChatGPT - other than I worry about the vast majority people in my scenario who do not understand AI.
AI can enable very misleading analysis and misinformation when a patient drives the conversation a certain way. Something I've observed in the community I'm a part of.
LLMs for medical info are good, but they're easily abuseable. I've got a friend who is an anxious mom. They use gpt/Gemini to "confirm" all of their suspicions and justify far more doctor/medical visits than is at all reasonable, while also getting access to more recurring antibiotics than is reasonable. LLMs are basically giving them the gun powder to waste the doctor's time and slam an already stressed medical system when all their kids need most of the time is some rest and soup.
Yea, I'm in a particular health community. A lot of anxious individuals, for good reason, end up posting a lot of nonsense they derived from self-influenced chatgpt conversations.
That said, when used as a tool you have power over - ChatGPT has also freed up some of my own anxiety. I've learned a ton thanks to ChatGPT as well. It's often been more helpful than the doctors and offers itself as an always-available counsel.
Another user above described the curve as K-shaped and that resonates to me as well. Above a certain line of knowledge and discernment the user is likely to benefit from the tool. Below the line, the tool can become harmful.
Yeah, it’s a very powerful tool, and it needs to be used carefully and with intent. People on Hacker News mostly get that already, but for ordinary users it’s a full-on paradigm shift.
It moved from:
A very precise source of information, where the hardest part was finding the right information.
To:
Something that can produce answers on demand, where the hardest part is validating that information, and knowing when to doubt the answer and force it to recheck the sources.
This happened in a year or two so I can't really blame. The truth machine where you doesn't needed to focus too much on validating answers changed rapidly to slop machine where ironically, your focus is much more important.
It’s super easy to stop fact checking these AIs and just trust they’re reading the sources correctly. I caught myself doing it, went back and fact checked past conversations, and lo and behold in two cases shit was made up.
These models are built to engage. They’re going to reinforce your biases, even without evidence, because that’s flattering and triggers a dopamine hit.
> This happened in a year or two so I can't really blame. The truth machine where you doesn't needed to focus too much on validating answers changed rapidly to slop machine where ironically, your focus is much more important.
Very much this for the general public. I view it as borderline* dangerous to anyone looking for confirmation bias.
As an interventional radiologist, I want it to be easier to see images from outside hospitals. Epic has nearly solved the problem of seeing outside medical records. Yet, I still can't see the images for the CT scan you had from the hospital across the street unless I call the file room and get the images transferred.
I imagine once data sharing is more robust, it would be easier to validate AI models (at least specifically for radiology).
This sounds like it will be one of those products which starts out as an optional service, but eventually becomes required to use if you want to participate in the overall healthcare system.
I think the consequences of hackers obtaining health data like this would be unimaginable. OpenAI is far inferior to Apple when it comes to privacy and security protection.
I find it ironic that the article is warning against AI use while it uses an AI-made cover image. Surely they find the same fault with copyright issues and AI art? Right?
Not mentioned in the article, but one interesting area where OpenAI could play is in participant identification and recruitment for clinical trials. In fact, ChatGPT could also help operate the clinical trials which is a highly paperwork intensive business, and therefore something that AI could add value to.
Ultimately pharmaceutical companies pay up to $100,000 per participant to hospital networks these charges must be itemized as expenses from the hospital on the most part (bounties are illegal usually.) open AI would provide a cheap way in for pharmaceutical companies to identify participants given that OpenAI has an incredible perspective into the physical and psychological state of their users. Imagine how much more is shared with OpenAI compared to a clinical trial coordinator at a hospital when a psychiatric drug is being tested.
This would also give OpenAI leverage in partnering with pharmaceutical companies. OpenAI executives have stated this is a goal, but otherwise they’ve made little progress on it.
It’s wild to imagine - someone with borderline personality disorder having delusional conversations with an AI chat Bot for six months, receiving an offer to participate in a clinical trial, and then having their subsequent AI conversations used as evidence to analyze the efficacy of the drug. The ironic thing is if that person had delusions about hidden forces listening to them…they’d be RIGHT!
Dystopian and frankly, gross. Its amazing to me that so many people are willing to give up control over their lives and in this case, their bodies, for the smallest inkling of ease.
The only thing you have control of in this world is your body (men only, women have already been denied body autonomy in the US), so giving this to the very entities that "do harm" as opposed to those who pledge to "do-no-harm", is straight up bonkers.
It's not the data or the use of said data for the intended purpose. There is a law of sorts in life that says what ever they promise, it will be broken. The data and its intended purpose will be perverted and ultimately used as a weapon against the very people who provided the data.
The LLM still provide value. They are much quicker than seeing a doctor, and with Deep Research for ChatGPT and whatever Gemini google search is calling it now you can actually get to see the sources from the information that it is looking at.
Parsing 100 different scientific articles or even google search results is not going to be possible before I get bored and move on. This is the value of LLM.
Even if the LLM data is used in training or sold off one way to protect oneself, is to add in knowingly incorrect data to the chat. You know it is incorrect, the LLM will believe it. Then the narrative is substantially changed.
Or wait like 6mo and the opensource Chinese models [Kimi/Qwen/Friends] will have caught up to Claude and Gemini IMO. Then just run these models quantized locally on Apple Silicon or GPU.
Do you believe that ChatGPT is doing the the research? I'm all in favor of better access and tools to research but at least in the US all of the research is being defunded, we're actively kicking researchers out of the country, and a bunch of white billionaires are proposing this as an alternative, based on training data they won't share.
This is a product feature that invalidates WebMD and the like. It does not solve any health problems.
> Dystopian and frankly, gross. Its amazing to me that so many people are willing to give up control over their lives and in this case, their bodies, for the smallest inkling of ease.
I've read people with chronic conditions reporting that chatgpt actually helped them land correct diagnosis that doctors did not consider so people are not just using that for "inkling of ease".
You will be assigned an individualized risk figure that will determine whether or not you are given coverage and treatment. Those decisions will happen without you or any MDs involvement. You will never know it happened and it will follow you for the rest of your life and your children's lives.
Don’t forget that majority of the commenters on this platform live in a country that views suffering in pain from incurable disease as a “god intended way” (and a horse dose of morphine). Take it with a grain of salt.
> Dystopian and frankly, gross. Its amazing to me that so many people are willing to give up control over their lives and in this case, their bodies, for the smallest inkling of ease.
You have to be extremely privileged to say something like this.
There’s no real smoking gun here showing what they are taking, storing, and using (or how they’re using it). But I do agree that nobody should dive in to this until that’s better understood as it is likely they are not following HIPAA and will not respect your privacy. Definitely not when there’s money on the table. Given their track record the concern is warranted.
If you lived in the US and you didn't like this product, you can just choose to not use it. What benefit do you as a citizen of Europe derive from having this withheld from you?
"You can just choose not to use it", sure, until signing a consent form to use ChatGPT becomes mandatory for a doctor visit, just like all kinds of other technology (like having a cell phone to verify SMS, for example) is basically essential now to function in society.
It is not that "this product is withheld from me". It is that we have laws to protect against abusive corporations. ChatGPT Health not being launched in EU is because OpenAI themselves realized it abuses peoples privacy.
> you didn't like this product, you can just choose to not use it
This is an over-simplification. I might like the product, but not be aware of the various ways it violates my privacy. Having laws that make it more risky for companies to do nefarious things makes me more confident that if a product is available in the EU market it doesn't do obviously bad things.
I get some of us here in the US have a near-allergic reaction to regulations or prohibition of any kind, but come on man. At some point you have to acknowledge we need the government to protect us from corporate greed, even on rare occasion. “Just don’t use it” is not a real argument when basically everyone is now expected to use LLM’s at work and beyond
> It is inconceivable for this demographic to think of a product that can enrich both the corporation and the users.
Would you care to provide an example of such a product, to dissuade this perceived demographic cohort? I am not so certain your creative name calling will yield much results, however.
ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this.
I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life.
(One example, if you are curious: I've been doing rehab for a back injury for about 10 years. I worked with a certified trainer/rehab professional for many years and built a program to keep me as pain-free as possible. I rebuilt the entire thing with ChatGPT/Gemini about 6 weeks ago, and I've had less pain than at any other point in my life. I spent at least 12 hours working with AI to test and research every exercise, and I've got some knowledge to help guide me, but I was amazed by how far it has come in 12 months. I ran the results by a trainer to double-check it was well thought out.)
This sounds like excellent evidentiary material for a future insurer or government health provider to decide you're uninsurable, not eligible for a job, and so on.
And the great thing about it is that you already signed all your rights away for them to do this exact thing, when we could have had an open world with open models run locally instead where you got to keep your private health information private.
Precisely right. Related. https://www.socialcooling.com/
Can you explain the exact way in which this is possible? It’s not legal to be denied jobs based on health. Not to deny insurance
44 replies →
> when we could have had an open world with open models run locally instead where you got to keep your private health information private
But we can have that? If you have powerful enough hardware you can do it, right now. At very least until the anti-AI people get their way and either make the models' creators liable for what the models say or get rid of the "training is fair use" thing everyone depends on, in which case, sure, you'll have to kiss legal open-weight models goodbye.
These strawman arguments lack nuance.
If the person can use AI to lead a noticeably better life, something that may have been impossible previously due to economic circumstance, then the first order benefits outweigh the second order drawbacks.
I’m not disputing what you’re saying, I just think that treating it like a zero sum game every time the conversation comes up is showing an immense amount of privilege.
You, me, the parent commenter; we’re all dying, we don’t have time to optimise for the best outcome.
2 replies →
This is an argument against the general data collection internet NOT chatGPT.
What do you consider the purpose of life to be? To me being in good health is immensely more important than health insurance, a government health plan, or a job.
I know that neither health insurers nor any government agency nor anybody else have even 0,0000000000000001% as much interest in my health, well being and survival as I do.
When it is the matter of my health and my life, I care as much about what an insurer or employer thinks as I would care about what the Ayatollah of Iran thinks. Or what you think. Ie: Those opinions are without any value at all.
4 replies →
System working as intended!
If an insurer is able to reduce (or recoup) costs from likelier risks, then the remaining insureds benefit from lower premiums.
If the goal is providing subsidies (i.e. wealth transfers), then insurance is not the way to do it. That is the government’s role.
46 replies →
I've had a similar positive experience and I'm really surprised at the cynicism here. You have a system that is good at reading tons of literature and synthesizing it, which then applies basic logic. What exactly do the cynics think that doctors do?
I don't use LLMs as the final say, but I do find them pretty useful as a positive filter / quick gut check.
This is the crux of the argument from the article.
> get to know your members even before the first claim
Basically selling your data to maximise profits from you and ensure companies don't take on a burden.
You are also not protected by HIPAA using ChatGPT.
1 reply →
Because we've all used LLMs.
The make stuff up. Doctors do not make stuff up.
They agree with you. Almost all the time. If you ask an AI whether you have in fact been infected by a werewolf bite, they're going to try and find a way to say yes.
3 replies →
I also think health (and car-problem diagnosis) are excellent tasks for LLMs.
The you-are-the-product thing, and privacy, has me wondering when Apple will step in and provide LLM health in a way we can trust.
I know I say that and I face the slings and arrows of those distrusting Apple, but I still believe they're the one big company out there that knows that there is money in being the one guy that doesn't sell your data.
I don't think one can deny the benefits here. The detractors here are like don't build a side walk coz someone may trip and fall or don't plant trees in your front yard coz of what happened to the Texas governor.
Most would likely agree that everything needs a balanced approach, bashing a service completely as evil and fully advocating people to stay away vs claiming the service is flawless (which the OP isn't doing btw) aren't either a balanced position.
Think different doesn't have to mean think extreme.
On the other hand, sometimes you end up like this guy. Are you feeling lucky?
https://arstechnica.com/health/2025/08/after-using-chatgpt-m...
You could also list plenty of horror stories where people went to medical professionals and got screwed over. There is this myth that people can go to doctors and get perfect attention and treatment. Reality is far from that
11 replies →
"…a 60-year-old man who had a “history of studying nutrition in college” decided to try a health experiment: He would eliminate all chlorine from his diet…"
You can see already that this can easily go sideways. This guy is already exploring the nether regions of self-medication.
It would be ideal if LLMs recognized this and would not happily offer up bromine as a substitute for chlorine, but I suspect this guy would have greedily looked for other shady advice if LLMs had never existed.
No, there's a difference between radically changing your diet and changing up your stretch/strength routine.. you don't just "end up" like one of them, you can evaluate that the downside risk of the latter is much lower and try it safely while recognizing that an extreme diet might not be so safe to try without any professional guidance.
You have to use your head, just like online forums or with doctors :)
I've had doctors tell me to do insane things. Some that caused lasting damage. Better to come with a trust-but-verify attitude to humans and AI.
Natural selection at work. I don’t see anything suspicious here.
The man in the article did not use it as a research help and did not verify it with experts.
So what's your argument?
Did he also drive into a lake following Google Maps' driving directions?
If you'd been doing the rehab for 10 years, what did you need exactly? It seems like you should have had a decade to ask whatever questions you wanted.
That was a specific example where AI helped me revamp my workout. No workout stays static; it has evolved over the years, in small ways. With this change I threw out 60% of it, and replaced it with a lot of work to make sure I was working full body and taking into account the injury. I was having more pain in 2025 and was only pain-free around 90% of the time. I wanted to get stronger but also revet everything I was doing to hopefully get out of that pain.
Hope that helps!
You can ask a trainer questions, they are super helpful and taught a lot, but it is still one person, and they don't often sit around at night reading university/research papers on the injury, etc.
It seems like outcomes are probably K-shaped: those who are capable of critical thinking and deciding what type of information should be confirmed by a healthcare professional and what type of information is relatively riskless to consume from ChatGPT should have positive outcomes.
Those who are prone to disinformation and misinterpretation may experience some very negative health outcomes.
I agree with that. The question I suppose is whether an LLM can detect, perhaps by the question itself, if they are dealing with someone (I hate to say it) "stable".
Anyone asking how to commit suicide, as a recent example, should be an obvious red flag. We can get more nuanced from there.
1 reply →
Or it's a placebo effect.
And if it didn't work out and made you worse or, god forbid, the advice caused you to get seriously injured, then what? ChatGPT won't take any responsibility.
I have so many issues with our current health system but an alternative is not an unreliable search tool that takes no responsibility for the information it provides.
You always have to use critical thinking, listen to your body, and get advice from trainers in the trenches. As I mentioned, I did all of those things :)
> And if it didn't work out and made you worse or, god forbid, the advice caused you to get seriously injured, then what? ChatGPT won't take any responsibility.
Realistically in 99% of actual cases where this happens due to human medical advice, the humans too won't take any responsibility.
on a similar vein, I have recurring back issues due to a spinal issue. I gave the issue to ChatGpT and it gave me almost all of the exercise I had been given years ago by a chiropractor. It's nowhere near a replacement for having someone coach me through movements though.
It can be helpful, but also untrustworthy.
My mother-in-law has been struggling with some health challenges the past couple of months. My wife (her daughter) works in the medical field and has been a great advocate for her mother. This whole time I've also been peppering ChatGPT with questions, and in turn I discuss matters with my wife based on this.
I think it was generally correct in a lot of its assertions, but as time goes on and the situation does it improve, I occasionally revisit my chat and update it with the latest results and findings, and it keeps insisting we're at a turning point and this is exactly what we should expect to be happening.
6 weeks ago, I think its advice was generally spot on, but today it's just sounding more tone-deaf and optimistic. I'd hate to be _relying_ on this as my only source of advice and information.
Totally agree, it can be a bit of an echo chamber. I had an infection post-dental-work. Bing Chat insisted I had swollen lymph nodes from a cold that would resolve on their own, then decided I had a salivary gland infection. After a follow-up with a real-world ENT, it was (probably accurately) diagnosed as a soft-tissue infection that had completely resolved on two rounds of antibiotics. The AI never raised that possibility, whereas the ENT and dentist examined me and reached that conclusion immediately.
I do think AI is great for discussing some health things (like "how should I interpret this report or test result?"), but it's too echo chamber-y and suggestion-prone for accurate diagnosis right now.
1 reply →
That's awesome that it's helped you so much, chronic back pain is awful. Is it possible though, that this could be interpreted as a failure of the trainer to come up with a successful treatment plan for you? "Sudden" relief after 10 years of therapy just because you changed the program seems like they were just having you perform the wrong exercises no?
We have to also understand that the trainer didn't get to spend 12 hours of researching every minutia or do a trial and error study to get to where OP got to. This doesn't necessarily mean the trainer failed, just that they were constrained by time, which OP wasn't. And I think that is the essence of this tech, when used wisely, I can lead to results like these which you can't get despite having access to the best talent for a limited time. Only the well afforded can afford a full time trainer/therapist.
1 reply →
The trainer was a godsend, got me to ~95% pain-free, and taught me all kinds of things. He is amazing.
But 2025 was maybe down to 90% pain-free, and I want to get stronger. So I did a big rewrite of my entire workout plan and checked everything. AI wasn't perfect, but it was amazing when you already know some.
It is still a tool I had to direct, and it took a few days of work. But I'm amazed at where it got me to. It took the injury into consideration and my main sport, and built around that. In the past I tried do this online and couldn't do it given the numerous factors involved. It was not perfect, but over the course of a few days, I was able to sort it out (and test with a trainer on the approach a few weeks after).
I've been 100% pain free for 6 weeks in a way I haven't felt in a long time.
2 replies →
> to communicate with doctors effectively
Did the doctors agree? I never thought of AI as a good patient navigator, but maybe that’s its proper role in healthcare.
Like anything, it is a tool; someone using WebMD badly, and someone can use it well.
I have found it helpful as I can ask ChatGPT questions, teach myself about what I am dealing with, and understand it better so I can ask my doctor questions. I still verify a lot, I still read articles on verified medical sites, etc., but it helps me do that a lot quicker, and I seem to learn quicker.
I'm sure someone can also go deep into anxiety with it as well if they approach it that way. It isn't a miracle button, but it is an AMAZING tool IME.
I agree. LLMs cannot and should not replace professionals but there are huge gaps that can be filled by intro provided and the fact that you can dig deeper into any subject is huge.
This is probably a field that MistralAI could use privacy and GDPR as leverage to build LLMs around that.
One of the big issues I have with LLMs that when you start a prompting session with an easy question it all goes great. It bring up points you might not have considered and appears very knowledgeable. Fact checking at this stage will show the LLM is invariably correct.
Then you start "digging deeper" on a specific sub-topic, and this is where the risk of an incorrect response grows. But it is easy to continue with the assumption the text you are getting is accurate.
This has happened so many times with the computing/programming related topics i usually prompt about, there is no way I would trust a response from an LLM on health related issues I am not already very familiar with.
Given that the LLM will give incorrect information (after lulling people with a false sense of it being accurate), who is going to be responsible for the person that makes themselves worse off by doing self diagnosis, even with a privacy focused service?
2 replies →
It doesn’t even have to be that well-read (although it is),
it just has to listen to your feedback more than 11 minutes per visit,
so it can have a chance at effectively steering you…
I'm lucky to live in Europe now, I cried the first time I went to a doctor here, he chatted with me for 45 minutes. I begged my doctor in the USA to let me book back-to-back sessions, so I could ask him questions and better understand what was going on. He said no; I only had 10 minutes, and he generally didn't have time to answer any questions or provide details. He was a good doc, but just couldn't take the time, and insurance wouldn't comp him for back to back appointments.
This kind of comment scares me because it's an example of people substituring professional advice for an LLM where LLMs are known to hallucinate or otherwise simply make stuff up. I see this all the time when I write queries and get the annoying Gemini AI snippet on a subject I know about and often I'll see the AI make provably and objectively false statements.
You have to use critical thinking + it helps to have some info on the subject + it shouldn't be used to perform self-surgery :)
I spent about 12 hours over 2 days, checking, rechecking, and building out a plan. Then I did 2-hour sessions on YouTube, over several weeks, learning the new exercises with proper form (and that continues as form is hard). Followed by an appointment with a trainer to test my form and review the workout as a hole (which he approved of). No trainer really knows how this injury will manifest, so a lot is also helped because I have 10 years of exp.
This isn't a button click, and now follow the LLM lemming. This is a tool like Google search but better.
I could not have done this before using the web. I would have had to read books and research papers, then try to understand which exercises didn't target x muscle groups heavily, etc. I just couldn't do that. The best case would have been a trainer with the same injury, maybe.
You are exaggerating. LLMs simply don’t hallucinate all that often, especially ChatGPT.
I really hate comments such as yours because anyone who has used ChatGPT in these contexts would know that it is pretty accurate and safe. People also can generally be trusted to identify good from bad advice. They are smart like that.
We should be encouraging thoughtful ChatGPT use instead of showing fake concern at each opportunity.
Your comment and many others just try to signal pessimism as a virtue and has very less bearing on reality.
12 replies →
I have this same reaction.
But I also have to honestly ask myself “aren’t humans also prone to make stuff up” when they feel they need to have an answer, but don’t really?
And yet despite admitting that humans hallucinate and make failures too, I remain uncomfortable with ultimate trust in LLMs.
Perhaps, while LLMs simulate authority well, there is an uncanny valley effect in trusting them, because some of the other aspect of interacting with an authority person are “off”.
>my ability to understand health problems
How do you know that this understanding is correct? To me, epistemologically, this is not too different from gaining your health knowledge from a homeopath or gaining your physics knowledge from a Flat Earther. You are in no position to discern the validity of your "knowledge".
It isn't a 0 or a 1; it is a spectrum. Doctors don't understand everything, either, which is the scary thing we don't like to realize.
What it specifically helps me to understand are things like: probable outcomes, symptoms in greater detail, as well as how they manifest in patient populations, explains it as if I was a 10/15/20 year old in detail to help me understand the basics of what might be going on, similar things in possible pharma options, general response treatments and pros/cons, etc.
I'm not using this to perform self-surgery or build a belief system :), I'm just trying to learn and understand what is going on at a better level.
Hope that helps :)
2 replies →
It's a lot easier to double-check, cross-reference, or test the validity of advice given by a gpt. It has no authority, no persuasion mechanisms, and its opinions are there in plain text ready to be picked apart. You can ask it for references and non-confrontationally challenge it on the things you're sceptical about. It generally avoids woo in my experience though it's hardly always correct in specific advice, it can definitely point you in productive directions. Which is completely different from discussing anything health with a homeopath, who at best will try to get you to avoid productive treatment and at worst poison you.
> You are in no position to discern the validity of your "knowledge".
He is the only one who is in that position, because he is the only person who is inside his body. He is physically and mentally a hundred percent in the position to discern the validity of the advice.
2 replies →
Anything you say can and will be used against you.
I've been on the web since it was born. When will this happen? :)
How is this manifesting in reality?
You bring up an interesting point.
How is it we have come to a place in society where we second-guess everything we type? But perhaps also where we go (with our "tracking devices" in our pockets…).
I mean, obviously the internet is what changed everything. But it is like you have a megaphone strapped to your face whenever you connect to a site and make a comment.
Maybe this is not a good thing.
Sounds like you’re a good little product… abundant potential for shareholder value to be extracted from you and others like you. A trip to the library or a consult with a professional would’ve given you the same or better results.
A phrase I liked to describe what we're doing with LLMs is "building a personal panopticon". The benefits are immense but you're placing a huge bet on the landlord of the tower.
Google did that, Facebook did that and every other company who boasted their user-base numbers did that. They sold user attention and harvested user data. Nothing new here.
Do users find value in it? Thats the ultimate question. I think it is a resounding yes.
Users found value in leaded gasoline too.
Which is not a helpful argument in this discussion.
It's to blunt and feels more ignorant.
4 replies →
Fascinating article.
Data security will be another important factor in whether we should choose our private health information with these third parties or not.
Manage My Health in NZ was hacked earlier this week: https://www.rnz.co.nz/news/national/583417/who-are-the-hacke...
If it is genuinely beneficial, this will become an open source project that everyone is able to run with a local agent in their house that runs cold. I will make one if no one else will, but discovering how to make it ubiquitously helpful and not drought with legal liability is challenging. I welcome a company willing to take this early risk.
ChatGPT mostly refuses to talk health issues , while i have found Gemini is reasonably cooperative when asking for things like symptoms and treatments .
This makes me not wanting to try out their new offering.
My dad used ChatGPT to guide him through testing, diagnosis, preparation, and recovery from a quadruple bypass. He never mentioned it refusing to talk about anything, just about how indispensable it was in the process and saved him months of time over skipping it and relying on the medical system alone, without help.
For example, it told him to go out and get a test on his own before meeting with a certain specialist, so the specialist didn’t order it during the first meeting and then need to wait for a follow up after reviewing it. He did this, gave the results to ChatGPT, which sounded the alarm. He sent a message with the results to his doctor and his appointment with the specialist was moved up to the same week, instead of 3 months out.
Is that foreshadowing of ChatGPT redirecting users to ChatGPT Health in some way? Base product no longer answers everything, now I need to pay an add-on fee to talk about health related things?
I doubt it. It's probably a CYA thing. There are a whole bunch of hot-button topics ChatGPT won't talk about, not because OpenAI will ever try to monetize them but because they're fodder for lawsuits.
It's quite easy to "jailbreak" by asking it to discuss hypotheticals, help you write accurate information for a fictional account, etc.
This is my experience too. Most bots are happy to discuss health stuff in a vacuum, which works for some queries.
What sorts of things did it refuse to talk to you about? I've talked with it about my health extensively and uploaded lab reports which it happily interpreted.
it reads the lab report but every one of its answers is prefaced with a refusal. It does provide some information but insists on general answers.
Example phrases it uses: "I can’t give medical advice or tell you what to do based on this report". "I will keep this general and informational, not personalized medical instructions."
1 reply →
Ive had fairly complex health issues and have never had issues with ChatGPT - other than I worry about the vast majority people in my scenario who do not understand AI.
AI can enable very misleading analysis and misinformation when a patient drives the conversation a certain way. Something I've observed in the community I'm a part of.
Not talking about acid reflux or back pain.
"While I can't provide medical advice..." is the 2025 version of "As a large language model trained by OpenAI..."
LLMs for medical info are good, but they're easily abuseable. I've got a friend who is an anxious mom. They use gpt/Gemini to "confirm" all of their suspicions and justify far more doctor/medical visits than is at all reasonable, while also getting access to more recurring antibiotics than is reasonable. LLMs are basically giving them the gun powder to waste the doctor's time and slam an already stressed medical system when all their kids need most of the time is some rest and soup.
Yea, I'm in a particular health community. A lot of anxious individuals, for good reason, end up posting a lot of nonsense they derived from self-influenced chatgpt conversations.
That said, when used as a tool you have power over - ChatGPT has also freed up some of my own anxiety. I've learned a ton thanks to ChatGPT as well. It's often been more helpful than the doctors and offers itself as an always-available counsel.
Another user above described the curve as K-shaped and that resonates to me as well. Above a certain line of knowledge and discernment the user is likely to benefit from the tool. Below the line, the tool can become harmful.
Yeah, it’s a very powerful tool, and it needs to be used carefully and with intent. People on Hacker News mostly get that already, but for ordinary users it’s a full-on paradigm shift.
It moved from: A very precise source of information, where the hardest part was finding the right information.
To: Something that can produce answers on demand, where the hardest part is validating that information, and knowing when to doubt the answer and force it to recheck the sources.
This happened in a year or two so I can't really blame. The truth machine where you doesn't needed to focus too much on validating answers changed rapidly to slop machine where ironically, your focus is much more important.
> People on Hacker News mostly get that already
It’s super easy to stop fact checking these AIs and just trust they’re reading the sources correctly. I caught myself doing it, went back and fact checked past conversations, and lo and behold in two cases shit was made up.
These models are built to engage. They’re going to reinforce your biases, even without evidence, because that’s flattering and triggers a dopamine hit.
> This happened in a year or two so I can't really blame. The truth machine where you doesn't needed to focus too much on validating answers changed rapidly to slop machine where ironically, your focus is much more important.
Very much this for the general public. I view it as borderline* dangerous to anyone looking for confirmation bias.
3 replies →
The HHS is asking for recommendations on how to leverage AI for healthcare: https://www.hhs.gov/press-room/hhs-ai-rfi.html
This is probably part of an effort to position them a potential vendor to help the government with this.
As an interventional radiologist, I want it to be easier to see images from outside hospitals. Epic has nearly solved the problem of seeing outside medical records. Yet, I still can't see the images for the CT scan you had from the hospital across the street unless I call the file room and get the images transferred.
I imagine once data sharing is more robust, it would be easier to validate AI models (at least specifically for radiology).
> This is probably part of an effort to position them (...)
who is "them" referring to in this sentence?
This sounds like it will be one of those products which starts out as an optional service, but eventually becomes required to use if you want to participate in the overall healthcare system.
Understand what you are trying to say but without giving an alternate solution what the reader would do with your thoughts?
I think the consequences of hackers obtaining health data like this would be unimaginable. OpenAI is far inferior to Apple when it comes to privacy and security protection.
I find it ironic that the article is warning against AI use while it uses an AI-made cover image. Surely they find the same fault with copyright issues and AI art? Right?
There's some irony in that, sure. But at the heart of the matter is privacy. It's about what you input into the chat, not about the output.
It’s not against AI. It’s against privacy issues arising though data mining & double speech.
> This isn’t just a health assistant. This is infrastructure for a healthcare marketplace.
It's an AI written article IMHO.
I interpreted that line as tongue-in-cheek, but on a second reading, I think you're right
Not mentioned in the article, but one interesting area where OpenAI could play is in participant identification and recruitment for clinical trials. In fact, ChatGPT could also help operate the clinical trials which is a highly paperwork intensive business, and therefore something that AI could add value to.
Ultimately pharmaceutical companies pay up to $100,000 per participant to hospital networks these charges must be itemized as expenses from the hospital on the most part (bounties are illegal usually.) open AI would provide a cheap way in for pharmaceutical companies to identify participants given that OpenAI has an incredible perspective into the physical and psychological state of their users. Imagine how much more is shared with OpenAI compared to a clinical trial coordinator at a hospital when a psychiatric drug is being tested.
This would also give OpenAI leverage in partnering with pharmaceutical companies. OpenAI executives have stated this is a goal, but otherwise they’ve made little progress on it.
It’s wild to imagine - someone with borderline personality disorder having delusional conversations with an AI chat Bot for six months, receiving an offer to participate in a clinical trial, and then having their subsequent AI conversations used as evidence to analyze the efficacy of the drug. The ironic thing is if that person had delusions about hidden forces listening to them…they’d be RIGHT!
Me and I hope they are selling me something to fix my RLS
I would give a lot of money to do so
My level of trust for data:
1) Claude
2) OpenAI
3) Grok
4) Gemini
Dystopian and frankly, gross. Its amazing to me that so many people are willing to give up control over their lives and in this case, their bodies, for the smallest inkling of ease.
The only thing you have control of in this world is your body (men only, women have already been denied body autonomy in the US), so giving this to the very entities that "do harm" as opposed to those who pledge to "do-no-harm", is straight up bonkers.
It's not the data or the use of said data for the intended purpose. There is a law of sorts in life that says what ever they promise, it will be broken. The data and its intended purpose will be perverted and ultimately used as a weapon against the very people who provided the data.
The LLM still provide value. They are much quicker than seeing a doctor, and with Deep Research for ChatGPT and whatever Gemini google search is calling it now you can actually get to see the sources from the information that it is looking at.
Parsing 100 different scientific articles or even google search results is not going to be possible before I get bored and move on. This is the value of LLM.
Even if the LLM data is used in training or sold off one way to protect oneself, is to add in knowingly incorrect data to the chat. You know it is incorrect, the LLM will believe it. Then the narrative is substantially changed.
Or wait like 6mo and the opensource Chinese models [Kimi/Qwen/Friends] will have caught up to Claude and Gemini IMO. Then just run these models quantized locally on Apple Silicon or GPU.
Blah blah blah.
I have a more niche genetic issue and I'm glad for you that you can think like this but no one cares enough to do the proper research for my problem.
If ml, massive compute, Google/chatgpt health do something in this direction (let's be honest anything) I'm glad for it.
You will be denied coverage and treatment because you volunteered your personal data with zero controls over its use and your rights. \
2 replies →
Do you believe that ChatGPT is doing the the research? I'm all in favor of better access and tools to research but at least in the US all of the research is being defunded, we're actively kicking researchers out of the country, and a bunch of white billionaires are proposing this as an alternative, based on training data they won't share.
This is a product feature that invalidates WebMD and the like. It does not solve any health problems.
> Dystopian and frankly, gross. Its amazing to me that so many people are willing to give up control over their lives and in this case, their bodies, for the smallest inkling of ease.
I've read people with chronic conditions reporting that chatgpt actually helped them land correct diagnosis that doctors did not consider so people are not just using that for "inkling of ease".
Yes, trading your privacy and autonomy for perceived ease is how they are going to steal your future and your freedom.
7 replies →
How is someone seeking for a way to deal with an inherited or environmentally caused illness giving up control of their body?
You will be assigned an individualized risk figure that will determine whether or not you are given coverage and treatment. Those decisions will happen without you or any MDs involvement. You will never know it happened and it will follow you for the rest of your life and your children's lives.
Don’t forget that majority of the commenters on this platform live in a country that views suffering in pain from incurable disease as a “god intended way” (and a horse dose of morphine). Take it with a grain of salt.
2 replies →
> Dystopian and frankly, gross. Its amazing to me that so many people are willing to give up control over their lives and in this case, their bodies, for the smallest inkling of ease.
You have to be extremely privileged to say something like this.
a) nobody is giving up control of their lives
b) get off your high horse, son
[flagged]
There’s no real smoking gun here showing what they are taking, storing, and using (or how they’re using it). But I do agree that nobody should dive in to this until that’s better understood as it is likely they are not following HIPAA and will not respect your privacy. Definitely not when there’s money on the table. Given their track record the concern is warranted.
Once again, glad to live in Europe.
If you lived in the US and you didn't like this product, you can just choose to not use it. What benefit do you as a citizen of Europe derive from having this withheld from you?
"You can just choose not to use it", sure, until signing a consent form to use ChatGPT becomes mandatory for a doctor visit, just like all kinds of other technology (like having a cell phone to verify SMS, for example) is basically essential now to function in society.
3 replies →
It is not that "this product is withheld from me". It is that we have laws to protect against abusive corporations. ChatGPT Health not being launched in EU is because OpenAI themselves realized it abuses peoples privacy.
> you didn't like this product, you can just choose to not use it
This is an over-simplification. I might like the product, but not be aware of the various ways it violates my privacy. Having laws that make it more risky for companies to do nefarious things makes me more confident that if a product is available in the EU market it doesn't do obviously bad things.
I get some of us here in the US have a near-allergic reaction to regulations or prohibition of any kind, but come on man. At some point you have to acknowledge we need the government to protect us from corporate greed, even on rare occasion. “Just don’t use it” is not a real argument when basically everyone is now expected to use LLM’s at work and beyond
1 reply →
[flagged]
> It is inconceivable for this demographic to think of a product that can enrich both the corporation and the users.
Would you care to provide an example of such a product, to dissuade this perceived demographic cohort? I am not so certain your creative name calling will yield much results, however.
> Would you care to provide an example of such a product
Go to a pharmacy and look at the shelves and you will find such products. All made by companies looking for a profit.
Or just look everywhere around you, and you will see things made by corporation for their profit, which you have purchased to enrich your own life.
It's literally everything that people in relatively free markets buy.
Microsoft Windows is a great example that people will get really angry about, but like bubble gum also enriches the producer, seller and buyer.
6 replies →
I mean… you don’t need to look very hard. Smart phones? Google Maps?
Is your life not enhanced by these products?
4 replies →
ChatGPT
6 replies →