arXiv AI

GateSPINE: Gated Cross-View Fusion for Lumbar Spine MRI Report Generation

GateSPINE is a vision‑language framework designed for automated lumbar spine MRI report generation. It fuses sagittal T1 and T2 volumes using a training‑free gated cross‑view fusion module, then encodes the fused sagittal and axial volumes with parallel 3D encoders before decoding the combined representation into a report. Evaluated on three datasets, GateSPINE achieves the highest clinical efficacy F1 scores, improving recall across all datasets while remaining competitive on standard natural language generation metrics.

Hugging Face Trending Papers
Jul 22

PhenSPINE: A Standardized Benchmark for Spine Pathology Diagnosis

The accurate diagnosis of spinal pathologies depends heavily on radiological interpretation, yet automated systems are hindered by the lack of diverse, high-quality benchmarks. In this study, we present PhenSPINE, a Magnetic Resonance Imaging dataset comprising 16,813 images from 250 patients, curated to facilitate advanced deep learning research.

arXiv AI
Jul 1

Seeing Through Multiple Views: Parameter-Efficient Fine-Tuning via Selective Neurons for Consistent Radiology Report Generation

arXiv:2606. 31099v1 Announce Type: cross Abstract: Recent years have seen substantial advances in radiology report generation (RRG), yet existing approaches predominantly adopt direct feature fusion when handling multi-view X-ray images.

By Yucheng Chen, Jinjing Zhu, Yang Yu, Yufei Shi, Hane Naghshbandi, Jinhua Liu, Angela S. Koh, Fang Fen, Kian Eng Ong, Si Yong Yeo
arXiv AI
Jun 9

Automatic Extraction of Structured Information from Brain MRI Reports Using an Open-Weight Large Language Model

arXiv:2606. 07721v1 Announce Type: new Abstract: Objectives: Automatic data extraction from free-text radiology reports enables large-scale research, but few studies assessed the performance of large language models (LLMs) on Dutch neuroradiology reports.

By Kaouther Mouheb, Amos Pomp, Antoine Manenti, Romy de Haan, Farog Faghir, Joy Martens, Harro Seelaar, Francesco Mattace-Raso, Meike W. Vernooij, Frank J. Wolters, Stefan Klein, Esther E. Bron
arXiv Computer Vision
Sep 3

The Diagnosis a Reporter Leaves Unspoken: Surfacing Frozen Tumor Features for Brain-Tumor MRI Reporting

The paper introduces NeuroFusion, an assistive brain‑MRI report generator that surfaces latent tumor signals from a frozen Mistral‑7B backbone. By adding discriminative field‑classifier heads over per‑lesion features, NeuroFusion restores accurate diagnoses (meningioma 0.92, metastasis 0.75) and improves prose quality while reducing latency 5–6×. A controlled negative result shows that overriding the decoder with a learned diagnosis pin harms performance, and grammar‑constrained decoding yields high schema‑validity (92.3%).

By Khawaja Murad ul Hassan, Ruqiyya Adil, Adil Qayyum, Rida Hassan, Asad Mansoor Khan, Muhammad Usman Akram, Mehran Ebrahimi
arXiv AI
Jun 2

CardioLens: Revealing the Clinical Reality Gap of MLLMs via Multi-Sequence Cardiac MRI Evaluations

arXiv:2606. 00123v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have shown strong performance on public medical benchmarks, yet existing evaluations often remain weak proxies for clinical use, relying on isolated inputs and simplified recognition-style tasks.

By Zixian Su, Hongkai Zhang, Fan Gao, Encheng Su, Taiping Qu, Jingwei Guo, Nan Zhang, Hui Wang, Zhen Zhou, Kairui Bo, Yan Chen, Yue Ren, Shuai Li, Lei Xu, Henggui Zhang
arXiv Machine Learning
Jun 25

Improving Factuality of 3D Brain MRI Report Generation with Paired Image-domain Retrieval and Text-domain Augmentation

arXiv:2411. 15490v2 Announce Type: replace-cross Abstract: Acute ischemic stroke (AIS) requires time-critical decision-making, where inaccurate interpretation of neuroimaging findings can lead to irreversible disability.

By Junhyeok Lee, Yujin Oh, Dahyoun Lee, Hyon Keun Joh, Chul-Ho Sohn, Sung Hyun Baik, Cheol Kyu Jung, Jung Hyun Park, Kyu Sung Choi, Byung-Hoon Kim, Jong Chul Ye
arXiv AI
2d ago

MIRTO: a registration-gated, multiverse-tested evaluation protocol for unsupervised anomaly segmentation in brain MRI

MIRTO is an evaluation protocol for unsupervised anomaly segmentation in brain MRI that explicitly documents key methodological choices—such as registration alignment, threshold setting, and false‑positive budgeting—and measures their impact. It applies a registration check, uses validation data for thresholding, reports realized false‑positive volumes, and repeats each comparison across 15,552 evaluation pipelines with bootstrap intervals. In a study on four UAD methods and 312 BraTS 2020 subjects, MIRTO revealed that an axis‑order mismatch dramatically lowered a diffusion model’s voxel AUROC, and that many performance differences were driven by lesion definition and threshold transfer rather than model quality.

By Negin Kafee Hernashki, Soumick Chatterjee
arXiv Computation and Language
Sep 23

MultiViewDx: Evidence-Linked Multi-View Clinical Diagnosis

MultiViewDx is a physician‑validated multimodal instruction dataset that links medical imaging studies with patient context and normalizes heterogeneous reports into an evidence‑linked workflow (evidence → findings → differential discussion → diagnosis). The dataset covers a wide range of imaging modalities and uses a unified image‑text retriever to ensure that instruction synthesis is grounded in source‑supported evidence. Fine‑tuned models on MultiViewDx achieve the highest average accuracy on four MedVQA benchmarks and receive the strongest overall rating on JAMA Clinical Challenge cases, with ablations confirming the importance of case‑level multi‑view organization and evidence‑linked reasoning.

By Junda Wang, Zonghai Yao, Yujan Ting, Eric Z. Chen, Hieu Tran, Hong Yu, Weijing Huang, Terrence Chen