arXiv Computer Vision

Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathology

The paper introduces Φ-Omni, a self‑supervised learning framework for computational pathology that disentangles synergistic information across histology, genomics, and clinical reports using Partial Information Decomposition. By employing a Synergistic Information Bottleneck and a ΦID objective, the method suppresses redundant signals while maximizing irreducible cross‑modal synergy, leading to improved few‑shot performance on breast and lung whole‑slide image datasets. The authors demonstrate that Φ-Omni outperforms both supervised and other SSL baselines on eight external tasks.

arXiv Machine Learning
Oct 12

The Predictability Bias of Joint-Embedding Predictive Learning in Medical Imaging

The paper introduces TAP-JEPA, a joint‑embedding predictive architecture trained on over 113,000 CT volumes, which achieves performance comparable to leading encoders in scan‑level classification. It demonstrates a predictability bias: while anatomy is largely predictable from context, pathology is not, leading to significant degradation in pathology detection when predictions are applied. The study audits the model’s predictive pathway, showing that pathology representations shift toward control regions and that removing pathology tokens minimally affects downstream decisions, underscoring that contextual predictability alone is insufficient for clinical relevance.

By Fabian Drexel, Bernhard Kainz, Jakob N. Kather, Daniel Rueckert, Lisa C. Adams, Keno K. Bressem, Cosmin I. Bercea
arXiv AI
Sep 25

M$^2$PFN: End-to-End Disentangled Alignment for Generalizable Multimodal In-Context Learning in Alzheimer's Disease

M$^2$PFN is an end‑to‑end multimodal framework that extends the TabPFN in‑context learning engine to Alzheimer’s disease diagnosis by aligning 3D‑MRI and tabular features in a shared subspace. It performs differentiable inference through TabPFN’s transformer, back‑propagates gradients into the encoders, and incorporates a frozen tabular‑only prediction via a gated shortcut. On the ADNI cohort it achieves 65.55 % macro‑F1 and 82.21 % macro‑AUC, surpassing unimodal and multimodal baselines, and it generalizes to external cohorts without retraining.

By Lujia Zhong, Shuo Huang, Jianwei Zhang, Xinyu Nie, Yonggang Shi
arXiv Computer Vision
Aug 21

MOSAIC: Modality-agnostic Spectral Alignment for Federated Image-level Weakly Supervised Tumor Segmentation under Client-specific Missing Modalities

arXiv:2608. 19788v1 Announce Type: cross Abstract: Trustworthy multimodal fusion in clinical settings requires handling incomplete and heterogeneous modality subsets across institutions, where privacy constraints prohibit centralized data sharing.

By Tarun Kumar Garg, Vaanathi Sundaresan
arXiv AI
Jun 30

BTI-Net: Bidirectional Decoder-Level Task Interaction via Uncertainty-Aware Gating for Multi-Task Medical Image Analysis

arXiv:2606. 29102v1 Announce Type: cross Abstract: Jointly learning to segment and classify medical images demands cross-task synergy, yet encoder-sharing architectures limit decoder reconstruction to task-private representations, permanently discarding the boundary cues and semantic priors each branch could supply to the other.

By Abdullah Al Shafi, Md Kawsar Mahmud Khan Zunayed, Safin Ahmmed, Sk Imran Hossain, Engelbert Mephu Nguifo
arXiv AI
Jun 8

DaX: Learning General Pathology Representations Across Scales

arXiv:2606. 06983v1 Announce Type: cross Abstract: Computational pathology requires visual representations that transfer across diverse clinical endpoints and remain robust to variation in magnification, staining, scanner type, slide preparation, and input resolution.

By Bokai Zhao, Yiyang Zhang, Long Bai, Tai Ma, Hanqing Chao, Minfeng Xu