arXiv Machine Learning

CCMAN: Cognitive Instability-Aware Cross-Modal Attention Network for Interpretable Temporal Biomarkers of Verbal Fluency Speech

arXiv Machine Learning
Oct 16

CogDrift-4D: Hierarchical Multimodal Modeling of Temporal Behavioral Decay for MCI Detection

CogDrift-4D introduces a hierarchical 4D Transformer framework for detecting mild cognitive impairment (MCI) by modeling temporal behavioral decay across seven unscripted multimodal interactions over 18 months. The approach represents continuous, multi‑session data as a dense 4D tensor and employs dual‑level modeling: intra‑session least‑squares regression to capture acute fading of facial and acoustic features, and an inter‑session recursive cross‑attention encoder to accumulate cumulative fatigue. A localized Quality Gate filters low‑integrity features, and early fusion integrates semantic and raw dynamics, achieving an MCI classification accuracy of 0.733 ± 0.13 and an F1‑score of 0.716 ± 0.14, surpassing advanced baselines.

By Sankalp Vaish, Sumukh Veeramalla, Rishank Singh, Caroline Summerour, John A. Batsis, Xiaohui Liang
arXiv Machine Learning
Oct 16

Task-Centric Multimodal Learning for Cognitive Impairment Detection

The paper introduces a contactless, multimodal screening framework that uses video, audio, and text data collected during structured voice interactions with Amazon Alexa to detect mild cognitive impairment (MCI). It evaluates three conversational tasks—spontaneous speech, comprehension, and recall—to determine which provides the most informative signals, compares unimodal models, and assesses multimodal fusion. Results show that while individual modalities perform best on specific tasks, the multimodal model consistently achieves higher accuracy (up to 0.76) across tasks, indicating that integrated behavioral cues can reliably distinguish MCI from healthy aging.

By Sankalp Vaish, Rishank Singh, Sumukh Veeramalla, Caroline Summerour, John A. Batsis, Xiaohui Liang
arXiv Computation and Language
Sep 28

Why Alzheimer's Speech Screening Fails to Generalize: Bridging the Deployment Gap via Cross-Corpus Evidence Anchoring

The paper examines why speech‑based screening for Alzheimer’s disease fails to generalize across different languages, tasks, and recording protocols. Using a leave‑one‑corpus‑out evaluation on four datasets, it finds that 59 of 70 interpretable speech features show conflicting patterns between healthy controls and cognitive risk groups, with pause, silence, and speech rate being highly protocol‑sensitive. The authors propose a fusion method that combines XLM‑R text baseline scores with evidence anchors, improving mean speaker AUC to 0.785 and worst‑case AUC to 0.615, and emphasize the importance of auditing feature transferability and reporting worst‑case domain robustness.

By Zijian Lu, Sizhe Liu, Yin Zhang, Jixuan Deng, Xinrong Lin, Xinchen Yuan, Chicheng Jin, Yiping Zuo, Yuanchao Li
arXiv Machine Learning
Oct 12

Acoustic Biomarkers for Alzheimer's Disease Detection from Spontaneous Speech

The study explores acoustic biomarkers derived from spontaneous speech to differentiate Alzheimer's disease patients from healthy controls. Using a structured picture‑description task, low‑level prosodic, spectral, and temporal features were extracted and fed into various machine learning classifiers. The best models achieved clinically meaningful separation between diagnostic groups, indicating that non‑invasive audio screening could aid early detection of dementia.

By Anh L Tran, Arjee Javellana Restar, Bereket Kindo
arXiv AI
Sep 1

TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment

arXiv:2608.30857v1 Announce Type: cross Abstract: Depression and anxiety in older adults with Mild Cognitive Impairment (MCI) are frequently underdiagnosed due to limited access to care. Multimodal a...

By Merna Bibars, Bolaji Omofojoye, Allan I. Levey, Rachel Hershenberg, Gari D. Clifford, Hyeokhyen Kwon