How we think about safety for users experiencing mental or emotional distress, the limits of today’s systems, and the work underway to refine them.
Summary generated by The Flow from the publisher's feed. The full article lives at OpenAI Blog.
Ensuring that AI systems are built, deployed, and used safely is critical to our mission.
An update on our safety & security practices
OpenAI collaborated with 170+ mental health experts to improve ChatGPT’s ability to recognize distress, respond empathetically, and guide users toward real-world support—reducing unsafe responses by up to 80%. Learn how we’re making ChatGPT safer and more supportive in sensitive moments.
arXiv:2608. 07902v1 Announce Type: cross Abstract: Youth increasingly turn to AI chatbots for social and emotional support, raising concerns about how these systems respond, especially in high-stakes situations.
arXiv:2607. 22692v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for emotional support despite lacking mechanisms to safely govern evolving mental health risk.