Task-Centric Multimodal Learning for Cognitive Impairment Detection

The paper introduces a contactless, multimodal screening framework that uses video, audio, and text data collected during structured voice interactions with Amazon Alexa to detect mild cognitive impairment (MCI). It evaluates three conversational tasks—spontaneous speech, comprehension, and recall—to determine which provides the most informative signals, compares unimodal models, and assesses multimodal fusion. Results show that while individual modalities perform best on specific tasks, the multimodal model consistently achieves higher accuracy (up to 0.76) across tasks, indicating that integrated behavioral cues can reliably distinguish MCI from healthy aging.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

• multimodal