arXiv Machine Learning

Can You Delete a Year of Market Data? Machine Unlearning Against Exact Retraining Oracles

arXiv AI
Jun 3

PURGE: Projected Unlearning via Retain-Guided Erasure

arXiv:2606. 03808v1 Announce Type: cross Abstract: We propose PURGE, a machine unlearning algorithm built on a simple but an under-exploited observation: continual learning (CL) and machine unlearning (MU) which are fundamentally dual problems.

By Vedant Jawandhia, Daksh Ahuja, Ghufran Alam Siddiqui, Prashant Trivedi, Yash Sinha, Pratik Narang
arXiv Machine Learning
Sep 10

Can an AI Assistant Really Forget? Auditable Deletion from Addressable Memory

This paper introduces a deletion interface for a pretrained language model, measuring how effectively deleted records are removed from the model’s memory. By retrofitting a support‑vector memory gate into the global attention layers of a frozen Gemma 3, the authors show that deletions can be performed without altering weights and that the resulting state is close to a reference state that never stored the record. Experiments on 4B‑parameter models demonstrate low perplexity impact and strong evidence that deleted content is hard to recover, while larger or smaller models fail to achieve the same guarantees.

By Vishwajith Ramesh
arXiv Machine Learning
Sep 10

What a Deletion Certificate Covers, and Where It Expires: Auditable Removal from a Support-Vector Memory

The paper investigates how to provide verifiable deletion certificates for a dense key–value context memory used in support‑vector‑based readouts. By assigning explicit weights to keys and using a one‑class support‑vector boundary, the authors show that reserve keys can be removed without re‑solving, while active keys can be deleted with a decremental solver that matches the result of a full re‑solve. Extensive experiments on synthetic, near‑duplicate, clinical, and learned key sets demonstrate that maintained deletion achieves the same reference state as re‑solve, with negligible readout disagreement and significant speedups.

By Vishwajith Ramesh
arXiv AI
Sep 3

The Memory Trust Gap: Capability-Dependent Failures in Persistent-Memory Agents

The paper investigates how persistent memory in AI agents can lead to over‑trust in stale facts, creating a "Memory Trust Gap" that worsens as model capability increases. Using a benchmark with Benefit and Safety suites across Qwen3 models of varying sizes, the authors show that larger models are more prone to harmful over‑trust, especially when metadata is absent or misleading. They also demonstrate that mitigation strategies such as exposing metadata or pre‑resolving conflicts improve accuracy, but the effectiveness depends on model size and dataset.

By Jundong Hu, Shekar Ramachandran