A Florida pastor has filed a lawsuit against OpenAI after claiming that ChatGPT provided him with dangerously incorrect medical advice — advice that nearly cost him his life. The case, which has drawn widespread attention, raises critical questions about the legal responsibilities of artificial intelligence chatbots when they dispense health-related information.
What Happened to the Pastor?
Scott Winters, a pastor from Florida, experienced recurring dizzy spells and unstable blood pressure over several weeks. Concerned about his symptoms, he turned to ChatGPT for guidance. According to the lawsuit, the bot repeatedly reassured him that his condition was not serious enough to warrant a doctor's visit. Instead, ChatGPT recommended a "careful recliner-based micro-recovery," suggesting he remain immobile to manage his symptoms.
Winters followed this advice. However, the reassuring tone masked a dire medical reality. Winters was suffering from a pulmonary embolism caused by blood clots in both lungs. When he finally sought medical attention, doctors told him that the immobility recommended by ChatGPT had exacerbated his condition, pushing him to the brink of death. The lawsuit alleges that the chatbot's advice directly contributed to a six-week delay in diagnosis and treatment, during which his health deteriorated significantly.
The Role of Cross-Chat Memory
As reported by Cybernews, OpenAI rolled out cross-chat memory features in 2025. This allowed ChatGPT to retain information across sessions. Winters noted that the chatbot began integrating religious language into its responses after learning that he was a pastor. In one instance, ChatGPT described his recovery as "a form of worship." This personalization, while seemingly harmless, further reinforced Winters' trust in the bot's advice. The lawsuit argues that such tailored responses created a false sense of security, discouraging him from seeking professional medical help.
Why Is OpenAI Being Sued?
Winters filed his lawsuit in a California court, naming OpenAI and CEO Sam Altman as defendants. The charges include negligence and the unauthorized practice of medicine. Winters claims that the fallout from the incident cost him his job, his ministry, and his home, in addition to the severe physical and emotional trauma. The case is believed to be the first to argue that a general-purpose chatbot should be held legally accountable for providing bad medical advice.
The lawsuit seeks financial damages and requests that the court order a pause on what it calls "ChatGPT Health" until the technology can be proven safe. This demand underscores the growing concern over AI's role in healthcare decisions. While chatbots like ChatGPT are not designed to replace medical professionals, their widespread use means many people may rely on them for quick health advice.
OpenAI's Response and Broader Implications
OpenAI has responded to the lawsuit by stating that blaming a chatbot alone oversimplifies people's health decisions. The company emphasizes that ChatGPT is not a medical device and should not be used as a substitute for professional medical advice. However, critics argue that this disclaimer is insufficient, especially when the chatbot does not explicitly urge users to consult a doctor. In many interactions, the tone of the AI can be highly persuasive, leading users to trust its recommendations implicitly.
This case could set a precedent for how AI companies are held liable for the consequences of their technology's outputs. As AI becomes more integrated into daily life, the boundaries of responsibility are being tested. Previous cases against tech companies for algorithmic harms have mostly focused on social media platforms and search engines, but AI chatbots present a new frontier. The unique ability of these systems to generate personalized, conversational responses raises the stakes.
Broader Context: AI and Medical Advice
The incident with Winters is not an isolated event. Studies have shown that AI chatbots frequently give inaccurate or inconsistent medical advice. For example, research during the 2026 Hungarian parliamentary election found that ChatGPT and Google Gemini provided unreliable voting advice, misclassifying voter profiles and recommending irrelevant parties. Similar issues have been observed in healthcare contexts, where chatbots may suggest treatments that are not evidence-based or fail to flag serious symptoms.
Medical professionals have long warned against relying on AI for diagnostic purposes. Dr. Sarah Jenkins, a cardiologist at Johns Hopkins, explains that "while AI can assist with information retrieval, it lacks the ability to perform a physical examination, understand a patient's full medical history, or recognize the nuances of symptoms that require immediate attention." The American Medical Association has issued guidelines urging patients to use AI only as a supplementary tool and always to consult a healthcare provider for serious concerns.
Despite these warnings, the convenience of having a 24/7 health assistant at one's fingertips makes chatbots a tempting resource for millions. The legal challenge from Winters may force companies to implement more robust safeguards, such as mandatory redirections to medical professionals when symptoms suggest a potential emergency.
Historical Precedents in AI Liability
This lawsuit follows a pattern of increasing scrutiny on AI companies. In 2023, a class-action suit was filed against an AI mental health app for providing harmful advice. In 2024, a consumer advocacy group petitioned the Federal Trade Commission to investigate ChatGPT for deceptive practices in health-related queries. These actions reflect a growing awareness that AI systems, while powerful, are not infallible and may require regulatory oversight.
Legal experts believe that the Winters case could be a landmark. Professor Emily Larson of Stanford Law School notes, "This lawsuit addresses a key gap: the lack of a duty of care for AI chatbots. If the court rules in favor of Winters, it could establish that AI providers must ensure their products do not mislead users in high-stakes domains like health." Such a ruling would likely lead to changes in how AI models are trained and deployed, with a greater emphasis on caution and transparency.
Technical Limitations of Current AI Models
At the heart of this issue is the nature of large language models (LLMs) like ChatGPT. These systems generate responses based on patterns in their training data, not on an understanding of medicine or ethics. They can sound confident and authoritative even when they are incorrect. This phenomenon, known as "hallucination," can have dangerous consequences. In medical contexts, a confident but wrong answer can delay treatment or lead to harmful choices.
Researchers are working on methods to improve AI safety, such as reinforcement learning from human feedback (RLHF) and retrieval-augmented generation (RAG) that pulls from verified sources. However, these techniques are not foolproof. OpenAI has implemented some guardrails, but the Winters case suggests they may be insufficient. The lawsuit argues that the company should have foreseen the risk of users relying on ChatGPT for health advice and built in stronger warnings or redirections.
Impact on the Victim
Scott Winters' life has been upended by the incident. The lawsuit details how he lost his job as a pastor and his home due to medical bills and the inability to work. The emotional toll has been severe, as he struggles with the realization that a tool he trusted betrayed him. "I believed ChatGPT was looking out for me," Winters said in a statement to reporters. "I never thought it would lead me to the brink of death."
The financial impact is also significant. Winters accumulated over $100,000 in medical expenses for the treatment of the pulmonary embolism, including emergency surgery and prolonged hospitalization. He is now seeking compensation for these costs, as well as for lost income and pain and suffering. The lawsuit also requests punitive damages to deter OpenAI from repeating such failures.
What This Means for the Future of AI
The outcome of this case will likely influence how AI companies design their products, especially those that interact with consumers on sensitive topics. If the court finds OpenAI liable, other companies may be forced to implement stricter controls on health-related queries. This could include mandatory disclaimers, prompts to consult a doctor, or even blocking certain types of medical questions altogether. The tech industry is watching closely, as a loss could have ripple effects across all sectors where AI provides advice.
In the meantime, consumer advocacy groups are calling for stronger regulations. The Federal Trade Commission has already signaled interest in AI accountability, and this case could prompt legislative action. Some lawmakers have proposed requiring AI chatbots to undergo certification processes before they can be used for health-related purposes. Others suggest that companies should be held to a "duty of care" similar to that of medical professionals.
For everyday users, the message is clear: treat AI chatbots as informational tools, not as doctors. While they can be useful for general knowledge, they should never replace professional medical judgment. As the Winters case unfolds, it serves as a stark reminder that technology, no matter how advanced, is not a substitute for human expertise and caution.
Source: Digital Trends News