arXiv AI By Xiaochen Wang, Yuan Zhong, Lingwei Zhang, Lisong Dai, Ting Wang, Fenglong Ma

MEDMKG: Benchmarking Medical Knowledge Exploitation with Multimodal Knowledge Graph

Read the original on arXiv AI →

MEDMKG is a new Medical Multimodal Knowledge Graph that combines visual data from MIMIC‑CXR with structured clinical knowledge from UMLS. The construction pipeline uses rule‑based tools and large language models for concept extraction and relationship modeling, and introduces a Neighbor‑aware Filtering algorithm to improve graph quality and compactness. Experiments on six datasets across three tasks show that MEDMKG enhances performance of twenty‑four baseline methods and four state‑of‑the‑art vision‑language backbones, providing a solid foundation for adaptive multimodal knowledge integration in medical AI.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 21

MKG-CARE: Case-Aware Reasoning with Multimodal Knowledge Graphs for Explainable Medical Image Diagnosis

arXiv:2605. 22547v3 Announce Type: replace-cross Abstract: Medical image diagnosis has achieved significant progress with deep learning, yet existing methods often rely on isolated visual evidence and lack the ability to effectively leverage similar cases and external knowledge.

By Yiming Xu, Yixuan Liu, Yuhang Zhang, Ling Zheng, Yihan Wang, Qi Song
arXiv AI
Jun 26

MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation

arXiv:2606. 26458v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) over knowledge graphs has emerged as a promising approach for grounding large language models, yet existing benchmarks largely overlook the challenges of retrieval in multimodal knowledge graph RAG (MKG-RAG).

By Xiaochen Wang, Bao Hoang, Han Liu, Ting Wang, Fenglong Ma
arXiv AI
Oct 19

Frozen Models, Evolving Expertise: Model-Agnostic Learning from Deployment Experience for Multimodal Medical AI

The paper introduces a model‑agnostic framework that lets frozen large language models (LLMs) and vision‑language models (VLMs) learn from deployment experience without retraining. It does so by adding three external expertise components—a Skill for guiding reasoning and tool use, a Knowledge Memory for storing reliable facts, and a Multimodal Knowledge Base for visual examples—and by using a validation strategy that updates only when new cases improve performance without harming past performance. Experiments on six benchmarks with both open‑weight and closed‑source models show up to a 34.2% performance gain on medical tasks, generalization to unseen cases, and transferability to other models and non‑medical domains.

By Yexiao He, Yucheng Tang, Pengfei Guo, Yufan He, Andriy Myronenko, Can Zhao, Ang Li, Daguang Xu, Dong Yang
arXiv Computation and Language
3d ago

Hierarchy-Aware Multimodal Unlearning for Medical AI

The paper introduces MedForget, a hierarchy‑aware multimodal unlearning benchmark that models medical data as nested institutional structures, allowing fine‑grained evaluation of retain and forget splits. Experiments reveal that existing unlearning methods struggle to achieve effective hierarchy‑aware forgetting without harming retained utility on clinically relevant tasks. To address this, the authors propose CHIP, a training‑free method that deletes target‑specific weight subspaces while preserving sibling‑shared information, achieving superior forget‑retain performance across all hierarchy levels while maintaining competitive downstream utility.

By Fengli Wu, Vaidehi Patil, Jaehong Yoon, Yue Zhang, Mohit Bansal