← Back to all news
arXiv Computer Vision By Vu Minh Tran, Thuc Huynh, Son Thanh Luu, Doanh C. Bui

ICGF-CXRMate: Image-Conditioned Clinical Context Compression and Gated Fusion for Chest X-ray Report Generation

Read the original on arXiv Computer Vision →

ICGF-CXRMate is a framework that compresses heterogeneous patient data into a fixed set of clinical context tokens conditioned on chest X‑ray images. These tokens are selectively fused with visual features via gated cross‑attention and also retained in the decoder prompt, yielding shorter prompts and higher report quality. Experiments on MIMIC‑CXR and MIMIC‑IV‑ED show significant gains in RadGraph‑F1, CXR‑BERT similarity, and BLEU‑4, while reducing prompt length by 22.9%.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Machine Learning
Jul 27

Autoregressive EHR Foundation Models with Multimodal Inputs

arXiv:2607. 22264v1 Announce Type: new Abstract: Autoregressive foundation models trained on tokenized electronic health records (EHRs) can support zero-shot clinical prediction, yet most operate on structured event codes alone, and do not incorporate multiple modalities in a principled way.

By Yuxuan Liu, Joshua Placidi, Jinpei Han, Alfred John Balston, Marek Rei, A. Aldo Faisal
multimodalsafety
More like this →
arXiv Machine Learning
Aug 20

Eyes on the Image: Gaze Supervised Multimodal Learning for Chest X-ray Diagnosis and Report Generation

The paper presents a two‑stage multimodal framework for chest X‑ray interpretation that incorporates radiologist gaze data from the MIMIC‑Eye dataset. Stage 1 introduces a gaze‑token classifier that fuses image patches, bounding‑box masks, transcription embeddings, and fixation maps, and a curriculum‑scheduled loss that improves accuracy and spatial alignment, yielding a 4.4% AUC gain and 13.3% F1 improvement. Stage 2 translates classifier predictions into region‑specific diagnostic sentences using confidence‑weighted keywords, an expert dictionary, and a prompted large language model, boosting clinical‑term BERTScore and ROUGE over keyword baselines.

By Tanjim Islam Riju, Shuchismita Anwar, Saman Sarker Joy, Farig Sadeque, Swakkhar Shatabda
llmsragmultimodalbenchmarkssafety
More like this →