arXiv Machine Learning

Evidence-Grounded Mapping of Multimodal Human Sensing Psychological Transdiagnostic Dimensions

The study introduces a clinician‑in‑the‑loop benchmark to assess whether large language models can generate evidence‑grounded Brief Hierarchical Taxonomy of Psychopathology (B‑HiTOP) item profiles from multimodal data, including passive sensing, ecological momentary assessment, and questionnaires. Using the GLOBEM dataset, the authors create 14,592 participant‑day instances aligned to 29 B‑HiTOP items across five spectra, and evaluate evidence compatibility rather than diagnostic accuracy. Two‑stage prediction improves compatibility for EMA and questionnaire evidence but reduces it for passive sensing and combined evidence, yielding more conservative score distributions across models, spectra, and evidence settings.

arXiv Computation and Language
Aug 28

BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing

BALMS is a benchmark for evaluating large language model (LLM) agents that analyze longitudinal wearable data to predict mental‑health wellbeing scores and generate evidence‑grounded rationales. It covers three real‑world datasets, two task families (score prediction and rationale generation), and tests five LLM backbones across open‑ and closed‑source paradigms. The study finds that zero‑shot agents rarely beat a simple mean baseline, and while chain‑of‑thought prompting helps reasoning, it does not ensure temporal grounding or numerical accuracy.

By Yu Yvonne Wu, Arvind Pillai, Yuliang Chen, Yuwei Zhang, Sudarshan Regmi, Tess Z. Griffin, Michael V. Heinz, Lisa A. Marsch, Nicholas C. Jacobson, Andrew Campbell
arXiv Computation and Language
Oct 9

A Formative Study of Brief Affective Text as a Complement to Wearable Sensing for Longitudinal Student Health Monitoring

The study examined whether ultra‑brief naturalistic concern text could complement wearable sensor data for monitoring student health. Over a year, 458 university students provided three‑word responses to a bi‑monthly prompt while wearing Oura rings, and the researchers compared different NLP methods to link these brief texts to nine sleep and physical activity outcomes. Findings indicated that weeks with academic‑concern framing correlated with lower physical activity, while emotional exhaustion language correlated with poorer sleep quality and lower heart rate variability, suggesting that affective content may add value to passive physiological monitoring.

By Tamunotonye Harry, Johanna Hidalgo, Matthew Price, Yuanyuan Feng, Kathryn Stanton, Connie Tompkins, Peter Sheridan Dodds, Mikaela Irene Fudolig, Laura Bloomfield, Christopher Danforth
arXiv Machine Learning
Sep 14

Explainable Prediction from Mobile Sensing Data through LLM-guided Concept Integration

The paper introduces a Concept-Integrated Transformer (CIT) that uses a pretrained large language model to generate concept abnormality targets with confidence weights, eliminating the need for manual concept annotation. CIT is applied to mobile sensing data from two longitudinal datasets, achieving the highest F1 score on the AFFECT dataset (0.756) and tying for the highest on a PHQ-9 dataset (0.765). The model’s learned concept scores reveal interpretable behavioral and physiological patterns, such as differences in sleep quantity and quality between high and low negative affect groups.

By Yuning Wang, Iman Azimi, Amir M. Rahmani, Pasi Liljeberg
arXiv AI
Jul 29

DynaBridge: Dynamic Summary-Guided Cross-Task Multimodal Fusion for DASS-Structured Mental Health Assessment

arXiv:2607. 25679v1 Announce Type: cross Abstract: Multimodal behavioral analysis offers a scalable approach to assessing depression, anxiety, and stress, yet generic fusion models often ignore the psychometric structure of questionnaire labels.

By Shiyu Teng, Haichen Yu, Jiaqing Liu, Hao Sun, Yu Song, Shurong Chai, Ruibo Hou, Lanfen Lin, Yen-Wei Chen
arXiv AI
Aug 11

Representation Matters in Longitudinal Affective Computing

arXiv:2608. 07518v1 Announce Type: cross Abstract: Longitudinal, in-the-wild, wearable sensing yields day-level physiology, sleep, activity, and environmental streams, whereas affect and cognition are labeled only episodically (per waves).

By Igor Matias, Maximilian Haas, Eric J. Daza, Matthias Kliegel, Katarzyna Wac
arXiv AI
Sep 3

Interpretable Symptom Vectors for Depression in a Large Language Model

The study investigates how a large language model, Gemma-3-27B-PT, internally represents depressive symptoms. By applying mechanistic interpretability methods to the model’s residual stream, researchers found that symptom groups are geometrically distinct at layer 21, and that projected symptom vectors align with clinician-annotated rankings across mood, somatic, and suicidality dimensions. Additionally, a single depression vector at this layer can differentiate depressive from non-depressive text with an AUC of 0.789, suggesting a potential emotional valence gate for symptom projection.

By Fangyi Zhu, Ajay Subramanian, Allison Constant, Camille Wang, Ravish Gupta, Corey J. Keller
arXiv Computation and Language
Sep 7

WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data

WearableQA is a new benchmark that tests AI systems on health reasoning using real-world wearable data from 200 users, each with up to 500 days of daily measurements. It contains 4,084 ten‑option multiple‑choice questions derived from wearable time series, blood biomarkers, and demographics, and is organized into 16 question types that distinguish data‑driven computation from physiological interpretation and single‑signal from cross‑signal reasoning. Evaluation of 14 large language models shows wide performance gaps, indicating that the benchmark remains challenging and useful for diagnosing model capabilities.

By Ji Soo Lee, Xilun Chen, Pierce Chuang, Ashish Shenoy, Jason Wei, Dohwan Ko, Hyunwoo J. Kim, Benoit Corda
arXiv Machine Learning
Oct 9

MC-TRCM: Observation-Aware Recursive Fusion for Incomplete Mobile and Wearable Mental-Health Feature Views

The paper introduces MC-TRCM, a Modality‑Conditioned Temporal Recursive Context Model that treats each feature source from mobile and wearable mental‑health datasets as a separate token and explicitly models missingness. By encoding observed values, summarizing missingness, and using learned absence tokens, the model refines predictions recursively and is conditioned on dataset and task embeddings. Evaluated on six endpoints from DepreST‑CAT and PSYCHE‑D, MC‑TRCM outperforms tabular baselines on PHQ‑9 and GAD‑7 severity prediction and matches or slightly exceeds reference performance on classification tasks, with ablations confirming the importance of feature‑wise modulation, absence tokens, missingness projections, and recursive refinement.

By Wentao Wang, Lifeng Han, Zining Ren, Hengyu Zhong, Guangyu Zou