arXiv Computation and Language

Identifying Effective Strategies in Prompt Evolution for Stress and Emotion Prediction

The study evaluates prompt evolution techniques for predicting stress and emotion from social media text. Six methods were compared on two model sizes, revealing that GEPA and its extension GEPA+merge consistently improved predictions over initial prompts. Five key prompting strategies—focusing on emotional evidence, distinguishing current from past distress, illustrating indirect cues, requiring emotional context, and guiding label selection—were linked to development gains, while four observations highlighted task-specific and evaluation limitations.

arXiv AI
5d ago

PromptSense: Sentiment-Aware Mental Health Chatbot with Dynamic Prompting

PromptSense introduces a sentiment‑aware mental health chatbot that incorporates sentiment and depression analysis with rule‑based filtering before model inference. By dynamically constructing prompts from emotional and risk insights, the system enhances contextual relevance, empathy, and safety of responses. Experiments across four model strategies and two prompt variants show that the engineered prompts outperform DSFT and RLAIF by 1.8% and 1.1% on qualitative metrics and toxicity assessments.

By Sugi Lee, Jianlong Zhou, Jing sUN
arXiv AI
Sep 21

Aligning with Lived Experience: Heterogeneous Benefits of Fine Tuning in Mental Health Support Generation

The paper introduces the COmmunity-centered Peer Engaged Support (COPES) dataset and a three‑axis evaluation framework to gauge how well Large Language Models (LLMs) align with community perspectives on mental‑health support queries. Experiments show that fine‑tuning LLMs on COPES improves strategy alignment and emotion‑tone alignment by over 50% for general‑purpose models, yet these gains are uneven across subreddits and coping strategies. The study also finds that post‑training shifts the model’s recommendations toward problem‑focused advice while reducing emotion‑focused responses, indicating persistent disparities in performance across different communities and needs.

By Mohit Chandra, Nabin Kim, Eli Min, Aamogh Sawant, Tanmay Sutar, Munmun De Choudhury
arXiv AI
Sep 30

Right Words, Wrong Moment: A Clinician-Grounded Analysis of Distress in 19,930 Conversations between Young People and ChatGPT

arXiv:2609.35953v1 Announce Type: new Abstract: Young people increasingly turn to General-Purpose Conversational Agents (GPCAs), such as ChatGPT, in moments of distress. We examine young adults' (age...

By Marx Wang, Ella Zhang, Cameron Tan, Andrea Mock, Songling Ngo, Zijing Wang, Robert Wolfe, Shirin Amouei, Rachel A. Hanebutt, Desmond C. Ong, Caroline Figueroa, Katie Davis, Anind K. Dey, Alexis Hiniker
arXiv Machine Learning
Aug 28

Cross-Platform Generalisation Failure in Mental Health Natural Language Processing: A Five-Axis Fairness Audit of Transformer Models on Social Media

The authors present the Cross-Platform Fairness Evaluation (CPFE) framework, a five‑axis audit protocol that assesses discriminative performance, calibration, statistical significance, prediction equity, and attribution stability of transformer models. Applying CPFE to four models trained on a Kaggle mental‑health corpus and tested on Reddit and Twitter, they find substantial cross‑platform degradation in AUC (30–40%) and severe calibration failures (ECE rising to 0.5 on Twitter). The study demonstrates that platform‑specific temperature scaling can largely fix calibration without harming discrimination, while prediction equity and attribution stability analyses reveal significant disparities and vocabulary divergence across platforms. The results argue that cross‑platform validation across all CPFE axes should become a standard requirement for mental‑health NLP systems deployed in heterogeneous environments.

By Rajveer Singh Pall, Sameer Yadav
arXiv AI
Jul 7

Where do LLMs Fall Short in CBT-Guided Affective Reasoning?

arXiv:2607. 02885v1 Announce Type: cross Abstract: Cognitive Behavioral Therapy (CBT) provides a structured framework for understanding a user's mental state by examining the interaction between cognitive and behavioral factors.

By Vaishnavi Sinha, Pooja Guttal, Pranay Deep Reddy Katike, Vishal Sinha, Gerald Ndawula, Lira Yoon, Andrea Kleinsmith, Manas Gaur