arXiv AI
Jun 10
Expert-Level Crisis Detection in Mental Health Conversations
arXiv:2606. 10380v1 Announce Type: cross Abstract: Real-world crisis intervention is inherently conversational, yet existing research largely focuses on static texts.
Risk Governance for Generative AI Mental Health Support: A Multi-Turn Safety Architecture
arXiv:2607. 22692v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for emotional support despite lacking mechanisms to safely govern evolving mental health risk.
Related stories
arXiv AI
Jun 17
Mental Health AI Safety Claims Must Preserve Temporal Evidence
arXiv:2605. 08827v2 Announce Type: replace Abstract: The safety of mental health AI is often judged at the wrong temporal scale.
arXiv AI
Jun 26
Auditing Framing-Sensitive Behavioral Instability in Large Language Models for Mental Health Interactions
arXiv:2606. 26982v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly being integrated into mental health support tools and other psychologically sensitive conversational applications.
arXiv AI
Jul 9
AI Chatbot Suicide Risk Detection and Response: Human Validation Study of the Open-Source VERA-MH Safety Evaluation
arXiv:2602. 05088v4 Announce Type: replace Abstract: Millions of people now use generative AI chatbots for psychological support.
arXiv AI
Jun 4
AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safety
arXiv:2606. 04867v1 Announce Type: new Abstract: As AI companion platforms such as Replika and Character.
arXiv AI
Jul 3
Copewell: A Multi-Agent Swarm Architecture for Equitable Mental Wellness Support
arXiv:2607. 02245v1 Announce Type: new Abstract: Mental health disorders affect nearly one billion people globally, yet 75% of individuals in low- and middle-income countries receive no treatment due to workforce shortages, cost barriers, and stigma.
arXiv Machine Learning
Jun 15
Trust but Verify: Mitigating Medical Hallucinations via Post-Hoc Adversarial Auditing and Multi-Agent Feedback Loops
arXiv:2606. 14149v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly deployed in healthcare settings, yet their tendency to hallucinate poses risks when clinical decisions are involved.
arXiv Machine Learning
Jun 30
CAREBench: A Child-Safety Risk Benchmark for Language Models
arXiv:2606. 29685v1 Announce Type: new Abstract: How can we evaluate whether frontier AI systems recognize child-safety risks before they escalate into explicit harm?
arXiv AI
Jun 17
Towards Understanding and Measuring COGNITIVE ATROPHY in LLM Behaviour
arXiv:2606. 18129v1 Announce Type: cross Abstract: Recent incidents involving LLMs used for mental-health support reveal a critical evaluation gap: surface-level safety scores do not capture how models behave across realistic, emotionally sensitive interactions over time.
Hugging Face Trending Papers
Jun 29
CAREBench: A Child-Safety Risk Benchmark for Language Models
How can we evaluate whether frontier AI systems recognize child-safety risks before they escalate into explicit harm? Existing child safety evaluations focus on child sexual abuse material, yet many child-safety failures begin earlier: in model assistance that helps adults manipulate, impersonate, profile, or isolate minors, and in model responses that deepen children's emotional dependence on AI systems rather than redirecting them toward human support.
arXiv AI
Jun 3
Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis
arXiv:2606. 03812v1 Announce Type: new Abstract: Operational safety in high-stakes domains such as industrial process control, autonomous, and safety-critical systems, demand reliable hazard identification.
arXiv AI
Jun 24
One Year Later...The Harms Persist, But So Do We!
arXiv:2606. 23884v1 Announce Type: cross Abstract: General-purpose large language models (LLMs) are increasingly used for mental health-related conversations, yet safety safeguards remain inadequate and inconsistent across clinical conditions.