arXiv AI

BioSync: Transformer-Based Cross-Modal Fusion for a Multimodal Physiological Digital Biomarker

BioSync is a transformer-based model that fuses cardiac, neural, behavioral, and speech data from wearables and mobile devices into a continuous composite digital biomarker called the BioSync Index (BSI). The architecture uses multi-head self-attention on modality tokens and a linear branch for feature concatenation, inspired by latent-variable measurement theory. Evaluations on synthetic cohorts for cognitive decline and metabolic-autonomic conditions show BioSync achieving AUCs of 0.928 and 0.764 accuracy/F1 of 0.766, outperforming simple concatenation and other fusion strategies in most corruption scenarios.

arXiv Machine Learning
Jul 14

Imputation-free transformer learning enables robust Alzheimer's disease prediction and calibrated uncertainty quantification across heterogeneous clinical cohorts

arXiv:2607. 11656v1 Announce Type: cross Abstract: Accurate diagnostic classification and disease-severity prediction for Alzheimer's disease are hampered by the incompleteness and heterogeneity of real-world clinical data.

By Christelle Schneuwly Diaz, Narmina Baghirova, Duy-Thanh Vu, Duy-Cat Can, Gilles Allali, Philippe Ryvlin, Oliver Y. Ch\'en
arXiv Machine Learning
Sep 18

Towards a Unified Modality-Agnostic Multimodal Framework for Cognitive Workload Assessment

The paper presents a modality‑agnostic, hierarchical Transformer framework for assessing cognitive workload using heterogeneous biosignals. In a pilot study, the authors evaluated all 31 combinations of five modalities (ECG, EDA, RESP, SpO₂, EEG) across three tasks (IQ, MATH, GAME) and found that EEG alone performed best, while adding more modalities did not consistently improve results. The full five‑modality model achieved the highest average accuracy (73.02% on IQ, 68.08% overall) and reduced model size by about 50% compared to late‑fusion approaches.

By Stefanos Gkikas, Christian Arzate Cruz, Calvin Joseph, Giorgos Giannakakis, Raul Fernandez Rojas
arXiv AI
Aug 3

Technological Advances in Detecting and Managing Cognitive Impairment in Older Adults: Trends, Challenges, and Future Directions

arXiv:2607. 28687v1 Announce Type: cross Abstract: As populations age, cognitive decline from mild cognitive impairment (MCI) to dementia is a defining health challenge of the coming decades, yet routine assessment often misses its earliest signs.

By Mohammad Asif, Azizuddin Khan, Mohd Azam, Anurag Rajkumar Bombarde
arXiv Computer Vision
Sep 14

A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data

The study presents an explainable multimodal deep‑learning framework that combines a 3D CNN for T1‑weighted MRI with a feedforward network for harmonized clinical and demographic data to diagnose Alzheimer’s disease. Using 6,479 ADNI records and 1,703 OASIS‑3 records, the authors compare various model configurations on three‑way and pairwise diagnostic tasks, finding that performance and explanations vary by task, modality, fusion strategy, and cohort. SHAP and Integrated Gradients consistently highlight the MMSE score as the most influential tabular feature, while CAM‑based explanations differ across model setups and cohorts, indicating that explainability is not a stable property under cohort shift.

By Yusuf Brima, Marcellin Atemkeng, Lakshmana Rao Namamula, Antoine Vacavant
arXiv Machine Learning
Jul 9

STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learning

arXiv:2607. 06629v1 Announce Type: new Abstract: Brain age -- the age inferred from a physiological recording -- is an emerging biomarker whose deviation from chronological age tracks neurological and psychiatric burden, and EEG is an attractive substrate for it because it is cheap, portable, and temporally rich.

By Roy Segal, Yoni Svechinsky, Tomer Fekete
arXiv Machine Learning
Sep 15

CCMAN: Cognitive Instability-Aware Cross-Modal Attention Network for Interpretable Temporal Biomarkers of Verbal Fluency Speech

arXiv:2609.14764v1 Announce Type: cross Abstract: Early detection of cognitive decline from speech offers a scalable and non-invasive alternative to conventional clinical assessment. Verbal fluency t...

By Madhurananda Pahar, Caitlin Illingworth, Dorota Braun, Daniel Blackburn, Heidi Christensen
arXiv Machine Learning
Jul 27

Autoregressive EHR Foundation Models with Multimodal Inputs

arXiv:2607. 22264v1 Announce Type: new Abstract: Autoregressive foundation models trained on tokenized electronic health records (EHRs) can support zero-shot clinical prediction, yet most operate on structured event codes alone, and do not incorporate multiple modalities in a principled way.

By Yuxuan Liu, Joshua Placidi, Jinpei Han, Alfred John Balston, Marek Rei, A. Aldo Faisal