The paper introduces a contactless, multimodal screening framework that uses video, audio, and text data collected during structured voice interactions with Amazon Alexa to detect mild cognitive impairment (MCI). It evaluates three conversational tasks—spontaneous speech, comprehension, and recall—to determine which provides the most informative signals, compares unimodal models, and assesses multimodal fusion. Results show that while individual modalities perform best on specific tasks, the multimodal model consistently achieves higher accuracy (up to 0.76) across tasks, indicating that integrated behavioral cues can reliably distinguish MCI from healthy aging.
By Sankalp Vaish, Rishank Singh, Sumukh Veeramalla, Caroline Summerour, John A. Batsis, Xiaohui Liang
arXiv:2607. 25679v1 Announce Type: cross Abstract: Multimodal behavioral analysis offers a scalable approach to assessing depression, anxiety, and stress, yet generic fusion models often ignore the psychometric structure of questionnaire labels.
By Shiyu Teng, Haichen Yu, Jiaqing Liu, Hao Sun, Yu Song, Shurong Chai, Ruibo Hou, Lanfen Lin, Yen-Wei Chen
arXiv:2608. 03611v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) integrates text, audio, and vision to infer human affect, yet real-world multimodal observations are often incomplete.
By Chunlei Meng, Jacqueline J. Pang, Pengbin Feng, Zhenyu Yu, Chun Ouyang, Zhongxue Gan
arXiv:2501. 16106v2 Announce Type: replace Abstract: Recent advances in multimodal depression recognition for clinical interviews (MDRC) have demonstrated the potential of AI systems by integrating textual, acoustic, and facial cues.
By Wenjie Zheng, Qiming Xie, Jianfei Yu, Yang Wang, Lei Cao, Fei Wang, Shijin Wang, Rui Xia, Chengqing Zong
arXiv:2609.14764v1 Announce Type: cross
Abstract: Early detection of cognitive decline from speech offers a scalable and non-invasive alternative to conventional clinical assessment. Verbal fluency t...
By Madhurananda Pahar, Caitlin Illingworth, Dorota Braun, Daniel Blackburn, Heidi Christensen
arXiv:2607. 21496v1 Announce Type: cross Abstract: Cognitive impairment (CI) is a growing public health concern.
By Yingchao Huang, Xin Wang, Yuhan Su, Shanshan Yao
MERID is a framework that uses recursive self‑improvement agents to autonomously develop multimodal pipelines for detecting major depressive disorder. It aligns multimodal records with depression targets, jointly modifies representations, fusion, and predictors, and guides revisions through evidence‑guided evolution to validate improvements before inheritance. Experiments on depression benchmarks show MERID outperforms existing multimodal and agent‑based baselines, especially highlighting the importance of acoustic and linguistic cues.
By Lei Liu, Zhaokang Liang, Qingcheng Zeng, Chenda Duan, Lu Mi, Zhen Tan, Tianyu Liu
arXiv:2608.21941v1 Announce Type: new
Abstract: Accurate assessment of patients in intensive care units (ICUs) is essential for timely clinical intervention and improved patient outcomes. Multimodal...
By Yixin Yang, Yueyang Sun, Weichen Liu, Xianbing Zhao, Sicen Liu
arXiv:2606. 06285v1 Announce Type: new Abstract: Time series foundation models (TS-FMs) aim to learn generalizable temporal representations that can be adapted to a wide range of downstream tasks.
By Ziwen Kan, Yishuo Chen, Kecheng Li, Andrew Wen, Xiaomeng Wang, Liwei Wang, Jihao Duan, Song Wang, Hongfang Liu, Tianlong Chen
arXiv:2605.22286v2 Announce Type: replace-cross
Abstract: Text-based counseling provides a valuable source of information for assessing depression severity. We study prediction of the total score on...
By Zhaomin Wu, Jiayi Li, Bingsheng He
The paper introduces MC-TRCM, a Modality‑Conditioned Temporal Recursive Context Model that treats each feature source from mobile and wearable mental‑health datasets as a separate token and explicitly models missingness. By encoding observed values, summarizing missingness, and using learned absence tokens, the model refines predictions recursively and is conditioned on dataset and task embeddings. Evaluated on six endpoints from DepreST‑CAT and PSYCHE‑D, MC‑TRCM outperforms tabular baselines on PHQ‑9 and GAD‑7 severity prediction and matches or slightly exceeds reference performance on classification tasks, with ablations confirming the importance of feature‑wise modulation, absence tokens, missingness projections, and recursive refinement.
By Wentao Wang, Lifeng Han, Zining Ren, Hengyu Zhong, Guangyu Zou
Accurate assessment of patients in intensive care units (ICUs) is essential for timely clinical intervention and improved patient outcomes. Multimodal electronic health records (EHRs), including struc...