arXiv Computation and Language By Junjie Xu, Jin Zhu, Yuzhe Yang, Luhan Wang, Xingjiao Wu, Daoguo Dong, Jing Yang, Wenxin Wu, Liang He

EviDial: When Correct Depression Predictions Lack Evidence

Read the original on arXiv Computation and Language →

EviDial is a new benchmark for depression dialogue that separates label agreement from evidence grounding. It contains 382 dialogues and 2,744 participant-symptom cells, each annotated as absent, partial, conflicting, or sufficient evidence. The study finds that most predictions that match benchmark labels lack sufficient textual evidence, highlighting a gap between label accuracy and evidence-based assessment.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Sep 3

Interpretable Symptom Vectors for Depression in a Large Language Model

The study investigates how a large language model, Gemma-3-27B-PT, internally represents depressive symptoms. By applying mechanistic interpretability methods to the model’s residual stream, researchers found that symptom groups are geometrically distinct at layer 21, and that projected symptom vectors align with clinician-annotated rankings across mood, somatic, and suicidality dimensions. Additionally, a single depression vector at this layer can differentiate depressive from non-depressive text with an AUC of 0.789, suggesting a potential emotional valence gate for symptom projection.

By Fangyi Zhu, Ajay Subramanian, Allison Constant, Camille Wang, Ravish Gupta, Corey J. Keller
arXiv AI
Sep 4

LongCounsel-8: A Benchmark Suite for Longitudinal Depression Tracking from Multi-Session Counseling Dialogues

LongCounsel-8 is a new benchmark suite comprising three datasets with 7,749 five‑session counseling dialogues, each grounded in real client profiles, depression trajectories, symptom compositions, and counseling patterns. The benchmark addresses challenges of longitudinal consistency, empirical grounding of symptom progression, and natural expression of controlled depression states without exposing labels. Experiments show that lower single‑session error does not ensure accurate trend detection, methods perform worse on worsening trajectories, and adding more session history can reduce trend prediction accuracy.

By Jiayi Li, Zhaomin Wu, Bingsheng He
arXiv AI
Sep 18

When Consistency Becomes Bias: Interviewer Effects in Semi-Structured Clinical Interviews

The paper examines automatic depression detection from doctor‑patient conversations and finds that models trained on semi‑structured interview data can achieve high accuracy by exploiting fixed interviewer prompts rather than the participants’ language. Across three datasets (ANDROIDS, DAIC‑WOZ, E‑DAIC), the authors show that restricting models to participant utterances distributes decision evidence more broadly and reflects genuine linguistic cues. The study highlights a cross‑dataset, architecture‑agnostic bias introduced by interviewer prompts and calls for analyses that localize decision evidence by time and speaker to ensure models learn from participants’ language.

By Hasindri Watawana, Sergio Burdisso, Diego A. Moreno-Galv\'an, Fernando S\'anchez-Vega, A. Pastor L\'opez-Monroy, Petr Motlicek, Esa\'u Villatoro-Tello
arXiv Computation and Language
Sep 3

Candidate Generation and Definition-Guided Verification for Sentence-Level Depression Symptom Recognition

The paper introduces a two‑stage framework for recognizing depression symptoms at the sentence level. First, a contrastively fine‑tuned sentence encoder generates a symptom candidate for each sentence. Then, a fine‑tuned language model verifies the candidate’s presence or absence by comparing the sentence, its context, and a diagnostic definition, ensuring the model’s judgment aligns with that definition before responding.

By Weiming Li, Catarina Barata, Miguel Constante, Joao Sanches