arXiv AI

inLoRA-MINT: Internal Representations for Auditing Training Data in Domain-adapted LLMs

The paper introduces inLoRA-MINT, an extension of the LoRA-MINT framework that uses intermediate model representations—such as activations and parameter-dependent signals—to perform Membership Inference Tests on large language models fine‑tuned with LoRA. By leveraging these representations, the method can distinguish training from non‑training samples without full parameter access, achieving 95–98% accuracy across four LLMs (Qwen, Phi‑4, DeepSeek‑V3, LLaMA 3.2‑3B) on medical, mathematical, and academic reasoning datasets. The approach offers a scalable way to audit sensitive training data and supports compliance with emerging privacy and AI governance regulations.

arXiv AI
Oct 15

Open-MMUnlearning: Unifying Methods and Evaluation for MLLM Unlearning

arXiv:2610.10358v2 Announce Type: replace Abstract: As multimodal large language models (MLLMs) become more capable and widely deployed, concerns about privacy and safety have become increasingly pre...

By Junkai Chen, Yuhao He, Qianshan Wei, Junxiang You, Jingwen Shao, Junkai Lin, Zhongkai Yue, Xiaotian Ye, Zhengbo Jiao, Jiali Cheng, Zhijie Deng, Kening Zheng, Ruiqi Liu, Hadi Amiri, Yi Yu, Zhenan Sun, Qi Li, Ka-Ho Chow, Sijia Liu, Liang Wang, Jiaqi Li, Shu Wu
arXiv AI
Oct 16

On the Privacy of LLMs: An Ablation Study

The paper examines privacy risks in large language models (LLMs) through a unified threat model and systematic ablation study of four attacks: Membership Inference, Attribute Inference, Data Extraction, and Backdoor Attacks. It finds that membership inference is highly sensitive to dataset and attack strategy, attribute inference depends on model and training characteristics, data extraction grows with model size and repeated training data, and backdoor attacks consistently succeed. The authors provide practical recommendations for privacy‑aware LLM deployment, such as prioritizing membership leakage checks in retrieval‑augmented systems, reducing repeated personal data in training, monitoring attribute inference, and protecting fine‑tuning pipelines from backdoors.

By Karima Makhlouf, Lamiaa Basyoni, Syed Khaderi, Gabriel Marquez, Peter Sotomango, Mahmoud Awawdah, Sami Zhioua