arXiv Computation and Language By Fengli Wu, Vaidehi Patil, Jaehong Yoon, Yue Zhang, Mohit Bansal

Hierarchy-Aware Multimodal Unlearning for Medical AI

Read the original on arXiv Computation and Language →

The paper introduces MedForget, a hierarchy‑aware multimodal unlearning benchmark that models medical data as nested institutional structures, allowing fine‑grained evaluation of retain and forget splits. Experiments reveal that existing unlearning methods struggle to achieve effective hierarchy‑aware forgetting without harming retained utility on clinically relevant tasks. To address this, the authors propose CHIP, a training‑free method that deletes target‑specific weight subspaces while preserving sibling‑shared information, achieving superior forget‑retain performance across all hierarchy levels while maintaining competitive downstream utility.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Jul 10

Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks

arXiv:2607. 07907v1 Announce Type: cross Abstract: With the growing adoption of VLMs, DMs, LLMs, and AFMs, these multimodal foundation models can inadvertently encode sensitive, copyrighted, biased, or unsafe cross-modal associations that originate from their training data.

By Nobin Sarwar, Shubhashis Roy Dipta, Zheyuan Liu, Vaidehi Patil
arXiv Machine Learning
4d ago

MLLMEraser: Achieving Test-Time Unlearning in Multimodal Large Language Models through Activation Steering

MLLMEraser is a training‑free, input‑aware framework that achieves test‑time unlearning for multimodal large language models by steering activations. It constructs an erasure direction through adversarial contrast between knowledge‑recall and knowledge‑erasure image‑text pairs, and applies this direction selectively to preserve retained knowledge while forgetting specified content. Experiments on LLaVA‑1.5 and Qwen‑2.5‑VL show that MLLMEraser outperforms existing unlearning baselines with lower computational cost and minimal utility loss.

By Chenlu Ding, Jiancan Wu, Leheng Sheng, Fan Zhang, Yancheng Yuan, Xiang Wang, Xiangnan He
arXiv AI
Oct 19

Frozen Models, Evolving Expertise: Model-Agnostic Learning from Deployment Experience for Multimodal Medical AI

The paper introduces a model‑agnostic framework that lets frozen large language models (LLMs) and vision‑language models (VLMs) learn from deployment experience without retraining. It does so by adding three external expertise components—a Skill for guiding reasoning and tool use, a Knowledge Memory for storing reliable facts, and a Multimodal Knowledge Base for visual examples—and by using a validation strategy that updates only when new cases improve performance without harming past performance. Experiments on six benchmarks with both open‑weight and closed‑source models show up to a 34.2% performance gain on medical tasks, generalization to unseen cases, and transferability to other models and non‑medical domains.

By Yexiao He, Yucheng Tang, Pengfei Guo, Yufan He, Andriy Myronenko, Can Zhao, Ang Li, Daguang Xu, Dong Yang
arXiv AI
Aug 5

Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation

arXiv:2608. 03791v1 Announce Type: new Abstract: Vision-Language Models (VLMs), like Large Language Models (LLMs), may memorize sensitive, copyrighted, or harmful knowledge from their pretraining corpora.

By Chunlin Liu, Junnian Chen, Haitong Jiang, Jianyu Zhao, Yingsen Pang, Jingchen Li, Jiabiao He, Youming Lu, Jinhe Bi, Yuntao Du