arXiv Machine Learning By Domenic Rosati, Alessa Carbo, Ali Dadsetan, Hong Huang, Matthew Young, Subhabrata Majumdar, Frank Rudzicz, Hassan Sajjad

Removing Information Content Does Not Certify Tamper Resistance in Open-Weight Models

Read the original on arXiv Machine Learning →

The paper investigates whether removing harmful information from open‑weight models can guarantee resistance to fine‑tuning attacks. It demonstrates that mutual information measured at model release is insufficient to certify tamper resistance, because function‑preserving reparameterizations can keep information unchanged while altering the gradient‑descent dynamics. The authors show that training order and parameterization can significantly affect recovery time, even when both weight–data and label–representation mutual information are zero, and they propose that certification must include constraints on attack dynamics beyond mutual information.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 7

Client-Side Probing of Deleted Ridge Statistics in Federated Unlearning

The paper investigates how federated unlearning systems that broadcast updated linear classifiers after each client update can inadvertently leak the compact, additive summaries used for deletion. By submitting known changes and analyzing the returned classifiers, an attacker can recover the deleted sample’s class or even reinstate it. Experiments on MNIST and CIFAR‑10 show that high‑precision broadcasts enable exact label recovery, while lower precision limits fine‑grained recovery and diverse responses can prevent identification.

By Yijun Quan, Giovanni Montana
arXiv Machine Learning
Sep 14

Correlation-Guided Fast Machine Unlearning via Hessian Analysis

The paper presents a fast machine unlearning method that uses Hessian analysis to identify correlated training data and applies a closed‑form update rule. This approach achieves an 82× speedup over traditional influence‑function unlearning while maintaining or slightly improving model accuracy. Experiments on seven dataset‑architecture pairs, including CIFAR‑100 with ResNet‑50, show strong forgetting performance and low vulnerability to membership inference attacks.

By Ayushi Thakur, Ruchir Gupta, Amit Kumar Jaiswal, Prayag Tiwari
arXiv AI
Jun 4

TamperBench: Systematically Stress-Testing LLM Safety Under Fine-Tuning and Tampering

arXiv:2602. 06911v2 Announce Type: replace-cross Abstract: As increasingly capable open-weight large language models (LLMs) are deployed, improving their tamper resistance against unsafe modifications, whether accidental or intentional, becomes critical to minimize risks.

By Saad Hossain, Tom Tseng, Punya Syon Pandey, Samanvay Vajpayee, Matthew Kowal, Nayeema Nonta, Samuel Simko, Stephen Casper, Zhijing Jin, Kellin Pelrine, Sirisha Rambhatla