arXiv Computation and Language By Qingming Li, Ruiyan Sun, Satoshi Nakamura

NarraSpace: Multimodal Scene-Grounded Evidence for Picture-Description Dementia Classification

Read the original on arXiv Computation and Language →

NarraSpace is a multimodal framework that links words and speech times to specific picture elements in picture‑description dementia classification tasks. It retrieves utterances for predefined scene events, summarizes coverage and temporal organization, and uses a frozen language model to contrast event text between Alzheimer’s disease and healthy controls, incorporating transcript surprisal and coverage metrics. On the Alzheimer’s Dementia Recognition through Spontaneous Speech benchmark, a support vector classifier built on these features achieves about 81% accuracy and 91% AUC, while the system preserves source records that map event scores back to utterances, speech intervals, and lexical matches.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computer Vision
Sep 14

DementiaCare-Bench: A Modality-Validated Video Benchmark

DementiaCare-Bench is a new video benchmark designed to evaluate video-language models (VLMs) on understanding behavioral and psychological symptoms of dementia (BPSD). It contains 56 caregiver training videos, 94 clips across nine BPSD categories, and 2023 questions that are grounded in transcript spans and labeled by their visual demand. The benchmark reveals that most VLMs perform well on questions answerable by language alone but struggle with those requiring ordered frames, and a lightweight LoRA fine‑tune (DemCare‑VLM) can improve video dependence.

By Afrouz Sheikholeslami, Yuankai Qi, Xuyun Zhang, Luping Zhou, Amin Beheshti, Quan Z. Sheng, Ming-Hsuan Yang