arXiv Computation and Language
Oct 16

Identifying Effective Strategies in Prompt Evolution for Stress and Emotion Prediction

The study evaluates prompt evolution techniques for predicting stress and emotion from social media text. Six methods were compared on two model sizes, revealing that GEPA and its extension GEPA+merge consistently improved predictions over initial prompts. Five key prompting strategies—focusing on emotional evidence, distinguishing current from past distress, illustrating indirect cues, requiring emotional context, and guiding label selection—were linked to development gains, while four observations highlighted task-specific and evaluation limitations.

By SeungHyun Yi, Seungjun Yi, Sriram Sattiraju, Haeun Park, Joakim Nguyen, Terence Lim, Joseph Skrovan, Mehak Beri, Hitakshi Modi, Eloy Carrion, Andrew Well, Carlos M. Mery, Alexander Rasgon, Mia K Markey, Ying Ding
arXiv AI
5d ago

PromptSense: Sentiment-Aware Mental Health Chatbot with Dynamic Prompting

PromptSense introduces a sentiment‑aware mental health chatbot that incorporates sentiment and depression analysis with rule‑based filtering before model inference. By dynamically constructing prompts from emotional and risk insights, the system enhances contextual relevance, empathy, and safety of responses. Experiments across four model strategies and two prompt variants show that the engineered prompts outperform DSFT and RLAIF by 1.8% and 1.1% on qualitative metrics and toxicity assessments.

By Sugi Lee, Jianlong Zhou, Jing sUN
arXiv AI
Sep 21

Aligning with Lived Experience: Heterogeneous Benefits of Fine Tuning in Mental Health Support Generation

The paper introduces the COmmunity-centered Peer Engaged Support (COPES) dataset and a three‑axis evaluation framework to gauge how well Large Language Models (LLMs) align with community perspectives on mental‑health support queries. Experiments show that fine‑tuning LLMs on COPES improves strategy alignment and emotion‑tone alignment by over 50% for general‑purpose models, yet these gains are uneven across subreddits and coping strategies. The study also finds that post‑training shifts the model’s recommendations toward problem‑focused advice while reducing emotion‑focused responses, indicating persistent disparities in performance across different communities and needs.

By Mohit Chandra, Nabin Kim, Eli Min, Aamogh Sawant, Tanmay Sutar, Munmun De Choudhury