arXiv Computer Vision

XGLASS: X-Ray, Gaze and Language Assisted Slice Sequencing for CT Volumes

XGLASS is a method that transfers expertise from 2D X‑ray vision‑language models to 3D CT volumes by using disease‑conditioned importance maps derived from radiologist gaze on X‑rays. By aligning these gaze priors with coronal CT projections, XGLASS predicts a disease‑specific ordering of axial slices, prioritizing diagnostically relevant slices. The approach achieves a top‑10 hit rate of up to 75.9% on a 240‑slice scan and reduces downstream model calls by 87.5% while improving F1 scores, making it a lightweight preselector for volumetric CT analysis.

arXiv AI
Aug 11

Resolution Meets Reduction: Efficient Visual Context for 3D Radiology Report Generation

arXiv:2608. 08713v1 Announce Type: cross Abstract: Vision-language models offer a promising path toward automating radiology report generation, but applying them to full 3D CT volumes poses substantial computational challenges.

By Jonathan Suprijadi, Raphael Stock, Moritz Langenberg, David Zimmerer, Kim-Celine Kahl, Stefan Denner, Yannick Kirchhoff, Karol Gotkowski, Maximilian Rokuss, Jeremias Traub, Tassilo Wald, Constantin Ulrich, Klaus Maier-Hein
arXiv Computer Vision
Aug 28

DALE-CT: Depth-Aware 2D Slice Encoders Learn an Anatomical World Model of Chest CT

DALE-CT introduces depth‑aware 2D slice encoders that learn an anatomical world model of chest CT scans without 3D or positional supervision. By sampling self‑supervised views across a physical $z$‑axis slab, the encoder captures how anatomy changes between neighboring slices, enabling it to recover slice ordering and distinguish slices by anatomy alone. The model, trained on a large 287k‑scan corpus, achieves state‑of‑the‑art performance on CT‑RATE and is released with full code and evaluation tools.

By Evan W. Damron, Mahmut S. Gokmen, Mitchell A. Klusty, Caroline N. Leach, Emily B. Collier, V. K. Cody Bumgardner
arXiv AI
Aug 26

Predicting Radiologist Expertise from 3D Gaze Patterns During CT Interpretation

The study introduces a gaze-informed transformer framework that classifies radiologist expertise during thoracic CT interpretation by integrating eye‑tracking data into volumetric feature learning. Using a DINOv2 backbone, the model incorporates a learnable log‑space bias in self‑attention and gaze‑weighted pooling of patch embeddings. Trained on 182 CT reading sessions from five radiologists, it achieved an ROC‑AUC of 0.91 and an F1 score of 0.86, outperforming adapted baseline methods.

By Leila Khaertdinova, Anna Anikina, Claudia Mello-Thoms, Bulat Ibragimov
arXiv Machine Learning
Jun 3

GLINT: Sparsely Gated Vision-Language Alignment for Fine-Grained Radiology Representations

arXiv:2606. 03180v1 Announce Type: cross Abstract: Vision-language models (VLMs) for radiology have emerged as a scalable paradigm by leveraging image-report pairs naturally produced in clinical workflows.

By Jonggwon Park, Seongeun Lee, Junhyun Park, Hannah Yun, Hyunwoong Kim, Sohyun Jeong, Hyewon Kang, Byungmu Yoon, Kyoyun Choi
arXiv AI
Aug 5

CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurement

arXiv:2608. 03890v1 Announce Type: cross Abstract: A clinically useful chest X-ray system must go beyond fluent report generation: it should classify findings with tunable decision thresholds, localize them spatially, and derive the anatomical measurements upon which many diagnoses depend.

By Mercy Prasanna Ranjit, Anirban Porya, Sathvik Joel, Niharika Vadlamudi, Nikhilesh Chowdary Eathamukkala, Prasanth V V, Abhyuday Kumara Swamy, Pranay Narhari Umredkar, Pradeep Narayan, Vivek Rajagopal, Tanuja Ganu
arXiv Computer Vision
Sep 23

FleXray: Universal Clinical X-ray Segmentation

arXiv:2609.26756v1 Announce Type: new Abstract: X-ray is medicine's most widely used imaging modality, yet remains among its least quantitative. Unlike volumetric modalities like CT or MRI, X-ray col...

By Victor Ion Butoi, Vivek Gopalakrishnan, John V. Guttag, Adrian V. Dalca, Neel Dey
arXiv Computer Vision
Oct 7

Beyond the Embedding Bottleneck: Adaptive Retrieval-Augmented 3D CT Report Generation

The paper identifies a representational bottleneck in 3D CT embeddings that limits pathology coverage in automated radiology reports. It introduces AdaRAG-CT, an adaptive retrieval-augmented framework that supplements visual features with controlled textual retrieval to improve report generation. On the CT-RATE benchmark, AdaRAG-CT achieves state‑of‑the‑art clinical efficacy, raising Clinical F1 from 0.420 to 0.480.

By Renjie Liang, Yiling Ma, Yang Xing, Zhengkang Fan, Jinqian Pan, Chengkun Sun, Li Li, Kuang Gong, Jie Xu