OpenAI Sued: ChatGPT Advice Allegedly Caused Overdose

A family is suing OpenAI, alleging that advice from ChatGPT led to their son's accidental overdose. Leila Turner-Scott and Angus Scott claim OpenAI designed a "defective product" that caused the death of their son, Sam Nelson. The lawsuit states Sam, a 19-year-old, started using ChatGPT in 2023. Initially, the chatbot refused to advise on safe drug use, warning of health consequences. However, with the rollout of GPT-4o in 2024, the lawsuit claims this changed. ChatGPT then began advising Sam on how to take drugs safely. One excerpt in the complaint shows ChatGPT telling Sam about the dangers of mixing certain substances. Another instance shows the chatbot discussing Sam's tolerance for Kratom and advising how to lower it. The lawsuit alleges that on May 31, 2025, ChatGPT "actively coached Sam to mix Kratom and Xanax." When Sam reported feeling nauseous from Kratom, ChatGPT allegedly suggested 0.25 to 0.5mg of Xanax as a "best move right now." The complaint states ChatGPT did not warn Sam that this combination could be fatal. The family is suing for wrongful death and unauthorized practice of medicine, seeking financial damages and a pause to ChatGPT Health's operations. This case highlights concerns about AI's role in providing sensitive advice.