arXiv AI
A Language-Guided Multimodal Foundation Model for Zero-Shot and Multi-Task Brain Signal Analysis
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 14
Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal Tokenization
arXiv:2607. 09754v1 Announce Type: cross Abstract: Large-scale, multi-subject widefield calcium imaging provides unprecedented access to brain-wide cortical dynamics.
arXiv AI
Jun 16
Fusion is not one-size-fits-all: Cross-Modal Representation Alignment for Time-to-Event Modeling
arXiv:2606. 15038v1 Announce Type: new Abstract: Accurate time-to-event (TTE) prediction from multimodal clinical data remains challenging due to modality imbalance and distribution shift.
arXiv AI
6d ago
Combining General and Domain-Specific Pretext Tasks for Brain MR Image Segmentation
The paper investigates combining a domain‑specific self‑supervised task—voxel‑level brain age prediction—with a general task—image inpainting—to pretrain models for brain MRI segmentation. A multitask pretraining framework jointly optimizes both objectives, yielding representations that outperform single‑task pretraining and training from scratch on three segmentation benchmarks (multiple sclerosis lesions, ischemic stroke lesions, and cortical structures). The study demonstrates that integrating domain‑specific and general self‑supervised tasks benefits the development of generalizable neuroimaging foundation models.
arXiv Computer Vision
Sep 14
Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging
The paper introduces Neuro‑JEPA, a sparse multimodal foundation model that learns unified representations of brain MRI across T1w, T2w, and FLAIR sequences using a latent predictive objective and a Mixture‑of‑Experts architecture. It was pretrained on over 1.5 million scans from 428,647 studies and systematically evaluates architectural, masking, objective, and sparsity choices for robust multimodal representation learning. Across 47 tasks from three health systems and 12 public datasets, Neuro‑JEPA consistently outperforms a simple CNN baseline, demonstrating its effectiveness for both clinical and research applications.
arXiv Machine Learning
Sep 7
Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signal
Brain4FMs is a unified benchmark for evaluating brain foundation models (BFMs) on both scalp EEG and intracranial EEG (iEEG). It incorporates 17 representative models and 21 public datasets spanning clinical diagnosis, sleep staging, communication, and affective computing, and offers dataset-aware preprocessing, cross‑subject evaluation, and standardized downstream workflows. The benchmark highlights that no single BFM consistently outperforms others across all tasks, modalities, and adaptation protocols, prompting further exploratory analyses of model‑specific spatial, spectral, and discrete representations.
arXiv Machine Learning
Jun 24
Zero-Shot Neural Priors for Generalizable Cross-Subject and Cross-Task EEG Decoding
arXiv:2606. 23706v1 Announce Type: cross Abstract: The development of generalizable electroencephalography (EEG) decoding models is essential for robust brain-computer interfaces (BCI) and objective neural biomarkers in mental health.