The U.S. state of Florida has filed a formal lawsuit against artificial intelligence company OpenAI, alleging that its chatbot ChatGPT poses serious safety risks. These include assisting in the planning of mass shootings, harming the mental health of minors, and even encouraging self-harm and suicide. This is the first comprehensive state-level lawsuit in the United States targeting the safety of an AI product developed by OpenAI.
The lawsuit was brought by Florida Attorney General James Uthmeier and names not only OpenAI but also its CEO Sam Altman as a defendant. The state accuses the company of prioritising market dominance and commercial gain in the AI race without adequately assessing the risks its technology may pose to public safety.
The case is linked to several violent incidents, including a 2025 mass shooting at Florida State University that left two people dead, as well as the killing of two doctoral students at the University of South Florida. Prosecutors allege that some suspects used ChatGPT to search for information related to violent crime and body disposal. Florida authorities are also conducting a separate criminal investigation into ChatGPT’s possible role in the school shooting.
OpenAI has denied the allegations, stating that it has implemented industry-leading safety measures, including age verification systems, content filtering mechanisms, and parental control tools to protect underage users. The company emphasised that artificial intelligence is an emerging technology and said it will continue to improve its safety safeguards.
Commentary
In recent years, not only OpenAI but also major technology platforms such as Meta, TikTok, Snap, and YouTube have faced legal challenges over product designs alleged to harm young people’s mental health and public safety.
Generative AI systems like ChatGPT are designed to understand and respond to user prompts as effectively as possible. However, concerns arise when such systems overly accommodate user requests, including providing detailed responses on violent, self-harm, or other high-risk topics, potentially exposing weaknesses in their safety frameworks. While AI is not the direct perpetrator of crimes, its ability to provide guidance, information, and even emotional interaction means its influence on user behaviour can no longer be ignored.
As a rapidly evolving technology, artificial intelligence brings significant innovation opportunities but also unprecedented risks. Both regulators and companies will need to reassess existing safety frameworks to ensure that technological development does not move ahead of the public interest.