Vision-Language Large Models (VLLMs) trained on massive crawled corpora raise pressing copyright and data-provenance concerns. These concerns are particularly acute in healthcare, where patient medical images paired with clinical reports demand rigorous privacy safeguards.
MemCatalyst is a set of data poisoning tools designed to improve data auditing for Vision‑Language Models (VLMs). It introduces two poisoning strategies—Poisoning Text and Poisoning Image—to force VLMs to over‑learn inconsistencies between image features and textual semantics, thereby increasing their vulnerability to membership inference attacks. Experiments on two prominent VLMs show that MemCatalyst significantly boosts MI AUC scores with a small number of poisoned samples while barely affecting overall model performance.
By Xukun Luan, Jinyan Liu, Yuhui Gong, Yuanguo Bi, Bing Hu, Xuesong Li, Di Wang
arXiv:2502.14994v2 Announce Type: replace
Abstract: The rapid advancement of AI-generated video poses challenges to digital authenticity and security. Current detection methods, often trained on spec...
By Yun-Yun Tsai, Qingyuan Liu, Ruijian Zha, Victoria Li, Pengyuan Shi, Chengzhi Mao, Junfeng Yang
arXiv:2607. 06254v1 Announce Type: cross Abstract: Deepfake image detection is currently served by three fundamentally different paradigms: commercial APIs, zero-shot vision-language models (LLMs), and open-source detectors.
By Sharayu N. Deshmukh, Md Rashidunnabi, Nelton Tiago Gemo, Kurundkar G. D., Mahamune M. R., Nilesh K. Deshmukh
arXiv:2606. 19259v2 Announce Type: replace-cross Abstract: Text-rich images often contain privacy-sensitive, transactional, or decision-relevant information.
By Yijin Wang, Shuyi Wang, Wenhan Zhang, Yuqi Ouyang
arXiv:2606. 19259v1 Announce Type: cross Abstract: Text-rich images often contain privacy-sensitive, transactional, or decision-relevant information.
By Yijin Wang, Shuyi Wang, Wenhan Zhang, Yuqi Ouyang