Clinicians and researchers urge AI firms to release safety data after chatbot crisis failures
Medical experts and researchers are demanding that artificial intelligence developers open up their safety data to address chatbot failures in handling users facing acute crises.

Stock photo for illustration only, not from the actual event
- Clinicians and researchers call on AI developers to share safety data
- Concerns grow as AI chatbots fail to adequately support users in crisis
- Experts emphasize transparency as a crucial step toward system improvements
A collective of clinicians and research experts has strongly asserted that artificial intelligence companies must transparently share their safety data with the broader scientific and medical communities. This call to action follows mounting evidence and growing concerns that current conversational AI models have fallen short when tasked with assisting users who are navigating severe emotional or psychological crises.
This issue has sparked widespread debate as large language models and chatbots become deeply integrated into daily routines, leading some vulnerable individuals to seek guidance from automated systems during critical moments. Unfortunately, the current infrastructure lacks the rigorous safety standards and specialized protocols necessary to properly assess and de-escalate crisis situations in real time.
Demanding transparency regarding AI safety metrics marks a critical turning point for the tech industry, where developers historically keep model evaluations proprietary. Allowing independent clinicians and psychologists to review safety frameworks can help establish reliable guardrails, ensuring that chatbots never inadvertently exacerbate distress or provide harmful advice to individuals in vulnerable states.
Source: Ars Technica
Found something wrong in this article? Report an issue with this article
Comments
Leave a Comment