arXiv Machine Learning By Roman Maksimov, Vladimir Aletov, Vladimir Solodkin, Dmitry Bylinkin, Daniil Medyakov, Aleksandr Beznosikov

Leveraging Association Context Retrieval in Knowledge Edit- ing to Build White-Box Attacks on LLMs

Read the original on arXiv Machine Learning →

The paper introduces a new white‑box attack on large language models that builds on knowledge‑editing techniques. By retrieving associative knowledge from the model, the attack extends constraint removal to a whole thematic category rather than just a predefined set of prompts. Experiments across different architectures show that this method improves attack effectiveness while preserving overall model performance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 25

The Tokens Remember: When Tokenization Bypasses Knowledge Editing and Unlearning

The paper investigates how tokenization can undermine post‑release guarantees that sensitive knowledge has been edited or unlearned from open‑weight large language models. By showing that alternative valid tokenizations can bypass localized modifications, the authors introduce Toketive, a reference‑free attack that detects modified knowledge and reconstructs pre‑edit responses using only the released model. Experiments on five LLMs, six datasets, and six editing techniques reveal that 38.6% of alternative tokenizations recover suppressed information, with Toketive achieving high detection and reconstruction accuracy.

By Manit Baser, Aditya Nawal, Dinil Mon Divakaran, Mohan Gurusamy