arXiv Computer Vision

From Image Interpretation to Clinical Reasoning: Upstream Physician-Context-Aware Multimodal Learning with Causal Reinforcement Learning

arXiv AI

Jul 29

Annotation-Assisted Learning of Treatment Policies From Multimodal Electronic Health Records

arXiv:2507. 20993v4 Announce Type: replace-cross Abstract: We study how to learn treatment policies from multimodal electronic health records (EHRs) that consist of tabular data and clinical text.

By Henri Arno, Thomas Demeester

multimodal

arXiv Computer Vision

Sep 22

Generating Chest X-Ray Counterfactuals by Specialising Foundation Image Models

arXiv:2609.24879v1 Announce Type: new Abstract: Counterfactual image generation answers questions about how a subject would have looked under retrospective, hypothetical scenarios. Recent methods hav...

By Xiaodan Xing, Rajat R. Rasal, Julia A. Meister, Sara Ghorayeb, Galvin Khara, Jessica Schrouff

diffusion

arXiv AI

1d ago

From Compound Figures to Medical Multi-image Reasoning: Scaling Multimodal Large Language Models with Biomedical Literature

arXiv:2511.22232v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) are increasingly capable in medical imaging, yet most focus on single-image settings. Clinical inter...

By Zhen Chen, Yihang Fu, Rong Zhou, Serina Applebaum, Min Kyu Kim, Aidan Gilson, Morten Lee, Salahudeen Mirza, Gabriel Madera, Mauro Giuffre, Yuanting Pan, Roy Jiang, Hyunjae Kim, Hua Xu, Qingyu Chen

llms reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

Jul 1

Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning

arXiv:2606. 31599v1 Announce Type: cross Abstract: Vision-language models (VLMs) combining reinforcement learning (RL) ignite remarkable progress in multimodal reasoning, yet still struggle with medical images, which typically exhibit extremely sparse visual evidence to inform clinical decision-making.

By Kaitao Chen, Weiqian Zhao, Jiamin Wu, Qihao Zheng, Shangquan Sun, Chunfeng Song, Xiaosong Wang, Mu Zhou, Mianxin Liu

llms nlp reinforcement-learning efficiency multimodal benchmarks

arXiv AI

Jul 1

Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning

arXiv:2606. 31825v1 Announce Type: cross Abstract: Recent multimodal large language models have shown great promise in clinical image reasoning, but existing post-training pipelines remain predominantly outcome-centric, relying on final answer correctness or sequence-level preferences.

By Junha Jung, Minbyul Jeong, Suhyeon Lim, Sungwook Jung, Jaehoon Yun, Taeyun Roh, Mujeen Sung, Jaewoo Kang

llms nlp reinforcement-learning multimodal benchmarks

arXiv Computation and Language

Aug 28

CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models

CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models proposes a new framework to improve medical reasoning in LLMs. It introduces two key conditions—Causal Sufficiency and Proximal Learnability—to curate high-quality training trajectories, using agreement-based self-verification and dynamic entropy bounds. Experiments on medical multimodal and text-only benchmarks show that CARE outperforms competitors, reducing incorrect reasoning and enhancing training stability.

By Yucheng Zhou, Peng Luo, Qianning Wang, Chengzhong Xu, Jianbing Shen

llms reinforcement-learning multimodal benchmarks

arXiv Machine Learning

Jun 29

EchoSonar-R: A Multi-View Reasoning-Enabled Model for Disease Classification and Report Generation in Echocardiography

arXiv:2606. 28164v1 Announce Type: cross Abstract: Echocardiography is the most widely used non-invasive cardiac imaging modality, providing essential information for cardiovascular diagnosis.

By Darya Taratynova, Ahmed Aly, Numan Saeed, Mohammad Yaqub

llms fine-tuning multimodal benchmarks safety

arXiv Machine Learning

Jul 14

Multimodal Routing for Interpretable, Robust, and Auditable Clinical Prediction

arXiv:2607. 09982v1 Announce Type: new Abstract: Electronic health record (EHR) data are inherently multimodal, and leveraging multiple modalities can improve predictive performance.

By Nikkie Hooman, Zhongjie Wu, Eric C. Larson, Mehak Gupta

multimodal safety

arXiv AI

Jun 2

RL-ACRGNet: Reinforcement Learning-Based Chest Radiology Report Generation Network

arXiv:2606. 02035v1 Announce Type: new Abstract: Medical imaging interpretation is a foundational pillar of modern clinical diagnostics, yet the manual generation of radiology reports remains a time-consuming process prone to interpretation inconsistencies.

By Yogesh Kumar Meena, Saurabh Agarwal, K. V. Arya

rag reinforcement-learning benchmarks

arXiv AI

Aug 21

MKG-CARE: Case-Aware Reasoning with Multimodal Knowledge Graphs for Explainable Medical Image Diagnosis

arXiv:2605. 22547v3 Announce Type: replace-cross Abstract: Medical image diagnosis has achieved significant progress with deep learning, yet existing methods often rely on isolated visual evidence and lack the ability to effectively leverage similar cases and external knowledge.

By Yiming Xu, Yixuan Liu, Yuhang Zhang, Ling Zheng, Yihan Wang, Qi Song

multimodal benchmarks safety

arXiv Computation and Language

Sep 23

Learning Diagnostic Reasoning for Decision Support in Toxicology

The paper introduces DeToxR, a reinforcement‑learning‑enhanced large language model designed to support decision making in acute toxicology cases. It fuses unstructured narratives from paramedics and patients with structured vital‑sign data to predict co‑ingested substances across 14 classes. In preliminary validation, DeToxR outperforms baseline models, achieving higher micro‑F1 and recall scores for poison identification.

By Nico Oberl\"ander, David Bani-Harouni, Tobias Zellner, Nassir Navab, Florian Eyer, Matthias Keicher

llms reinforcement-learning

arXiv Computer Vision

Aug 25

Radiologist-Guided Causal Concept Bottleneck Models for Chest X-Ray Interpretation

arXiv:2605.07785v3 Announce Type: replace Abstract: Concept Bottleneck Models (CBMs) in medical imaging aim to improve model interpretability by predicting intermediate clinical concepts before final...

By Amy Rafferty, Rishi Ramaesh, Ajitha Rajan

benchmarks safety

Related stories