The paper discusses the rapid progress of machine unlearning for multimodal large language models (MLLMs) and the need for rigorous evaluation. It identifies three pitfalls in current benchmarks: lack of held‑out evaluation, reliance on synthetic fine‑tuned knowledge, and unfair comparisons across methods. To address these issues, the authors propose GEMMU, a benchmark using real‑world knowledge and a principled protocol, and show that re‑evaluating existing methods under GEMMU uncovers significant generalization gaps.
By Oscar Chew, Po-Yi Lu, Yi-Jie Cheng, Kunal Jain, Hsuan-Tien Lin, Zhengzhong Tu, Kuan-Hao Huang
arXiv:2610.14763v1 Announce Type: new
Abstract: Multimodal large language models (MLLMs) can reproduce sensitive, copyrighted, or unsafe information from their training data. Effective unlearning mus...
By Chenlu Ding, Jiancan Wu, Yanchen Luo, Tianyu Zhang, Yancheng Yuan, Xiang Wang, Xiangnan He
arXiv:2606. 11652v1 Announce Type: new Abstract: This paper investigates reinforcement learning (RL) methods for improving tool-calling capabilities in multimodal small language model (SLM) agents.
By Yifan Yang, Zhen Zhang, Jiayi Tian, Liyan Tan, Zheng Zhang
UniData is a universal multimodal instruction generation pipeline that transforms simple user requirements into multi‑round, multimodal instructions. It expands user inputs into diverse events, uses an any‑to‑any large model for instruction generation, and refines the output by correcting irrelevant or redundant inference flows. The authors also introduce UniDataset, a 20,000‑entry dataset spanning nine modalities, and show that UniData achieves state‑of‑the‑art data quality and improves other multimodal models’ understanding and generation capabilities.
By Jiaqi Tang, Yi-Feng Wu, Yuting Zhang, Hao Lu, Bowen Fu, Qing-Guo Chen, Xiaogang Xu, Yuwei Hu, Shiyin Lu, Wei Wei, Lei Zhang, Zhao Xu, Weihua Luo, Qifeng Chen, Ying-Cong Chen
arXiv:2607. 18615v1 Announce Type: cross Abstract: Machine unlearning for vision-language models (VLMs) remains underexplored.
By Zijie Liu, Jinhao Duan, Gaowen Liu, Sijia Liu, Tianlong Chen
arXiv:2608. 03791v1 Announce Type: new Abstract: Vision-Language Models (VLMs), like Large Language Models (LLMs), may memorize sensitive, copyrighted, or harmful knowledge from their pretraining corpora.
By Chunlin Liu, Junnian Chen, Haitong Jiang, Jianyu Zhao, Yingsen Pang, Jingchen Li, Jiabiao He, Youming Lu, Jinhe Bi, Yuntao Du