arXiv Computer Vision

Adaptive Temporal Gating of Longitudinal Magnetic Resonance Imaging for Dementia Prediction

arXiv Computer Vision
Oct 9

A Two-Scan Deep Learning Model for Predicting Dementia in Mild Cognitive Impairment

The paper introduces TAFNet, a temporal attention fusion network that uses both a baseline and a follow‑up T1‑weighted brain scan to predict which individuals with mild cognitive impairment (MCI) will progress to dementia. The model employs a pretrained Siamese encoder for each scan and fuses the two scans through anatomical difference, cross‑temporal attention, joint context, and a learned per‑patient gate. Evaluated on paired scans from the Alzheimer’s Disease Neuroimaging Initiative, TAFNet outperforms single‑scan networks and a simple scan‑difference model, achieving significant gains in cross‑validation and maintaining high sensitivity at clinically reasonable specificity.

By Sara Fin, Alireza Moayedikia, David J. White, Uffe Kock Wiil, Alicia Troncoso
arXiv Computer Vision
Sep 14

A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data

The study presents an explainable multimodal deep‑learning framework that combines a 3D CNN for T1‑weighted MRI with a feedforward network for harmonized clinical and demographic data to diagnose Alzheimer’s disease. Using 6,479 ADNI records and 1,703 OASIS‑3 records, the authors compare various model configurations on three‑way and pairwise diagnostic tasks, finding that performance and explanations vary by task, modality, fusion strategy, and cohort. SHAP and Integrated Gradients consistently highlight the MMSE score as the most influential tabular feature, while CAM‑based explanations differ across model setups and cohorts, indicating that explainability is not a stable property under cohort shift.

By Yusuf Brima, Marcellin Atemkeng, Lakshmana Rao Namamula, Antoine Vacavant
arXiv Computer Vision
Sep 7

A Generalizable Feature Extractor for Alzheimer's-Related Brain MRI Tasks

The study investigates whether a compact, supervised 3D CNN pretrained for brain‑age prediction can act as a reusable foundation model for various Alzheimer's‑related neuroimaging tasks. By freezing the 7.18 million weights and adding only ~1 % of trainable parameters via Low‑Rank Adaptation, the model achieved high performance across six experiments, including dementia classification, MCI progression prediction, amyloid positivity detection, and volume estimation of hippocampal and white matter hypointensities. The results demonstrate that the pretrained brain‑age model generalizes well to new datasets without retraining, offering a data‑efficient alternative to larger networks.

By Reza Rajabli, D. Louis Collins
arXiv Machine Learning
Oct 12

The Predictability Bias of Joint-Embedding Predictive Learning in Medical Imaging

The paper introduces TAP-JEPA, a joint‑embedding predictive architecture trained on over 113,000 CT volumes, which achieves performance comparable to leading encoders in scan‑level classification. It demonstrates a predictability bias: while anatomy is largely predictable from context, pathology is not, leading to significant degradation in pathology detection when predictions are applied. The study audits the model’s predictive pathway, showing that pathology representations shift toward control regions and that removing pathology tokens minimally affects downstream decisions, underscoring that contextual predictability alone is insufficient for clinical relevance.

By Fabian Drexel, Bernhard Kainz, Jakob N. Kather, Daniel Rueckert, Lisa C. Adams, Keno K. Bressem, Cosmin I. Bercea
arXiv Machine Learning
Oct 9

Leakage-Controlled Multimodal Learning for Diagnosis and Progression Prediction in Alzheimer's Disease Research

The paper introduces a leakage‑controlled multimodal learning framework for diagnosing and predicting the progression of Alzheimer’s disease. It combines an adapted SFCN MRI encoder, four causal clinical Transformers, shared fusion, and task‑specific ODE‑GRU dynamics, with fine‑tuning and LoRA for MRI blocks. Across 2,649 subjects and 17,317 visits, the model achieves high AUROCs for diagnosis and progression, and demonstrates strong external validation on OASIS‑3 data.

By Akeem Temitope Otapo, Ghazaleh Khodabandelou, Zuheng Ming, Alice Othmani