arXiv AI By Jiahui Guang, Haiyan Wang, Yingjie Zhu, Cuiyun Gao, Jing Li, Di Shao, Zhaoquan Gu

ASRU: Activation Steering Meets Reinforcement Unlearning for Multimodal Large Language Models

Read the original on arXiv AI →

arXiv:2605. 15687v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) may memorize sensitive cross-modal information during pretraining, making machine unlearning (MU) crucial.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
1d ago

Are We Really Measuring Forgetting? Pitfalls in Evaluating Machine Unlearning for Multimodal LLMs

The paper discusses the rapid progress of machine unlearning for multimodal large language models (MLLMs) and the need for rigorous evaluation. It identifies three pitfalls in current benchmarks: lack of held‑out evaluation, reliance on synthetic fine‑tuned knowledge, and unfair comparisons across methods. To address these issues, the authors propose GEMMU, a benchmark using real‑world knowledge and a principled protocol, and show that re‑evaluating existing methods under GEMMU uncovers significant generalization gaps.

By Oscar Chew, Po-Yi Lu, Yi-Jie Cheng, Kunal Jain, Hsuan-Tien Lin, Zhengzhong Tu, Kuan-Hao Huang
arXiv AI
Oct 9

UniData: Universal Multimodal Instruction Generation Pipeline

UniData is a universal multimodal instruction generation pipeline that transforms simple user requirements into multi‑round, multimodal instructions. It expands user inputs into diverse events, uses an any‑to‑any large model for instruction generation, and refines the output by correcting irrelevant or redundant inference flows. The authors also introduce UniDataset, a 20,000‑entry dataset spanning nine modalities, and show that UniData achieves state‑of‑the‑art data quality and improves other multimodal models’ understanding and generation capabilities.

By Jiaqi Tang, Yi-Feng Wu, Yuting Zhang, Hao Lu, Bowen Fu, Qing-Guo Chen, Xiaogang Xu, Yuwei Hu, Shiyin Lu, Wei Wei, Lei Zhang, Zhao Xu, Weihua Luo, Qifeng Chen, Ying-Cong Chen
arXiv AI
Aug 5

Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation

arXiv:2608. 03791v1 Announce Type: new Abstract: Vision-Language Models (VLMs), like Large Language Models (LLMs), may memorize sensitive, copyrighted, or harmful knowledge from their pretraining corpora.

By Chunlin Liu, Junnian Chen, Haitong Jiang, Jianyu Zhao, Yingsen Pang, Jingchen Li, Jiabiao He, Youming Lu, Jinhe Bi, Yuntao Du