arXiv Machine Learning

MC-TRCM: Observation-Aware Recursive Fusion for Incomplete Mobile and Wearable Mental-Health Feature Views

The paper introduces MC-TRCM, a Modality‑Conditioned Temporal Recursive Context Model that treats each feature source from mobile and wearable mental‑health datasets as a separate token and explicitly models missingness. By encoding observed values, summarizing missingness, and using learned absence tokens, the model refines predictions recursively and is conditioned on dataset and task embeddings. Evaluated on six endpoints from DepreST‑CAT and PSYCHE‑D, MC‑TRCM outperforms tabular baselines on PHQ‑9 and GAD‑7 severity prediction and matches or slightly exceeds reference performance on classification tasks, with ablations confirming the importance of feature‑wise modulation, absence tokens, missingness projections, and recursive refinement.

arXiv AI
Sep 3

FemWear: A Parameter-Efficient Wearable Foundation Model for Women's Health

FemWear is a parameter‑efficient wearable foundation model specifically tailored for women's health. It repurposes a pretrained multimodal wearable backbone by training only 239,236 encoder parameters—just 1.11% of the original 21.54M—using low‑rank residual adapters and causal task‑family heads to create a shared longitudinal representation for menstrual, symptom, affective, sleep/recovery, autonomic, activity, and pregnancy outcomes. Evaluations across six cohorts and 63 metrics show improvements in cycle‑phase macro‑F1 and reductions in mean absolute error for cramps, mood symptoms, and sleep problems, while maintaining the OpenMHC ability‑retention benchmark.

By Yifan Wang, Chenzhong Li
arXiv Machine Learning
Sep 14

Explainable Prediction from Mobile Sensing Data through LLM-guided Concept Integration

The paper introduces a Concept-Integrated Transformer (CIT) that uses a pretrained large language model to generate concept abnormality targets with confidence weights, eliminating the need for manual concept annotation. CIT is applied to mobile sensing data from two longitudinal datasets, achieving the highest F1 score on the AFFECT dataset (0.756) and tying for the highest on a PHQ-9 dataset (0.765). The model’s learned concept scores reveal interpretable behavioral and physiological patterns, such as differences in sleep quantity and quality between high and low negative affect groups.

By Yuning Wang, Iman Azimi, Amir M. Rahmani, Pasi Liljeberg
arXiv Computation and Language
Aug 28

BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing

BALMS is a benchmark for evaluating large language model (LLM) agents that analyze longitudinal wearable data to predict mental‑health wellbeing scores and generate evidence‑grounded rationales. It covers three real‑world datasets, two task families (score prediction and rationale generation), and tests five LLM backbones across open‑ and closed‑source paradigms. The study finds that zero‑shot agents rarely beat a simple mean baseline, and while chain‑of‑thought prompting helps reasoning, it does not ensure temporal grounding or numerical accuracy.

By Yu Yvonne Wu, Arvind Pillai, Yuliang Chen, Yuwei Zhang, Sudarshan Regmi, Tess Z. Griffin, Michael V. Heinz, Lisa A. Marsch, Nicholas C. Jacobson, Andrew Campbell
arXiv AI
Sep 7

BioSync: Transformer-Based Cross-Modal Fusion for a Multimodal Physiological Digital Biomarker

BioSync is a transformer-based model that fuses cardiac, neural, behavioral, and speech data from wearables and mobile devices into a continuous composite digital biomarker called the BioSync Index (BSI). The architecture uses multi-head self-attention on modality tokens and a linear branch for feature concatenation, inspired by latent-variable measurement theory. Evaluations on synthetic cohorts for cognitive decline and metabolic-autonomic conditions show BioSync achieving AUCs of 0.928 and 0.764 accuracy/F1 of 0.766, outperforming simple concatenation and other fusion strategies in most corruption scenarios.

By Seyed Mahmoud Sajjadi Mohammadabadi
arXiv AI
Sep 1

TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment

arXiv:2608.30857v1 Announce Type: cross Abstract: Depression and anxiety in older adults with Mild Cognitive Impairment (MCI) are frequently underdiagnosed due to limited access to care. Multimodal a...

By Merna Bibars, Bolaji Omofojoye, Allan I. Levey, Rachel Hershenberg, Gari D. Clifford, Hyeokhyen Kwon
arXiv AI
Aug 26

Evaluating Deep Multivariate Imputation Models on Wearable Device Data

The paper introduces a new evaluation protocol for deep multivariate imputation models on wearable device data, addressing the issue of structured missingness where sensor features drop out together. Using a Garmin smartwatch dataset from an epilepsy patient, the authors generate realistic block-missing patterns from training data and show that matching the training protocol to this distribution reduces BRITS’ mean absolute error by 43%. They also extend BRITS with time‑of‑day encoding and compare it to linear interpolation and SAITS, finding that no single model dominates and that model rankings vary with evaluation design.

By Skye Goodman, Roussel Desmond Nzoyem, Leandro Junges, Peter Kissack, Yasser Qureshi, Amberly Brigden, Jeff Clark, Nawid Keshtmand
arXiv Machine Learning
Aug 27

Evidence-Grounded Mapping of Multimodal Human Sensing Psychological Transdiagnostic Dimensions

The study introduces a clinician‑in‑the‑loop benchmark to assess whether large language models can generate evidence‑grounded Brief Hierarchical Taxonomy of Psychopathology (B‑HiTOP) item profiles from multimodal data, including passive sensing, ecological momentary assessment, and questionnaires. Using the GLOBEM dataset, the authors create 14,592 participant‑day instances aligned to 29 B‑HiTOP items across five spectra, and evaluate evidence compatibility rather than diagnostic accuracy. Two‑stage prediction improves compatibility for EMA and questionnaire evidence but reduces it for passive sensing and combined evidence, yielding more conservative score distributions across models, spectra, and evidence settings.

By Xiyun Hu, Xiangyuan Xue, Yuting Lyu, Hanya Shao, Jingping Nie
arXiv Computation and Language
Oct 9

A Formative Study of Brief Affective Text as a Complement to Wearable Sensing for Longitudinal Student Health Monitoring

The study examined whether ultra‑brief naturalistic concern text could complement wearable sensor data for monitoring student health. Over a year, 458 university students provided three‑word responses to a bi‑monthly prompt while wearing Oura rings, and the researchers compared different NLP methods to link these brief texts to nine sleep and physical activity outcomes. Findings indicated that weeks with academic‑concern framing correlated with lower physical activity, while emotional exhaustion language correlated with poorer sleep quality and lower heart rate variability, suggesting that affective content may add value to passive physiological monitoring.

By Tamunotonye Harry, Johanna Hidalgo, Matthew Price, Yuanyuan Feng, Kathryn Stanton, Connie Tompkins, Peter Sheridan Dodds, Mikaela Irene Fudolig, Laura Bloomfield, Christopher Danforth