arXiv AI

Measuring Memory and Generalization as Separable Geometric Channels: The Topo^2 Framework

arXiv AI
Jun 29

Applicability of memorization indicators for early spotting of overfitting while recalibrating sEMG-decoders on low sample sizes

arXiv:2606. 27855v1 Announce Type: cross Abstract: Deep learning models for surface electromyography (sEMG) can benefit substantially from subject-specific (re-)calibration, since no sufficiently large and diverse datasets are available to train fully generic decoders.

By Stephan J. Lehmler, Tobias Glasmachers, Ioannis Iossifidis
arXiv AI
Oct 1

Unmerge: Efficient Machine Unlearning via Task Arithmetic

The paper introduces Unmerge, an efficient machine unlearning algorithm that treats unlearning as the inverse of task arithmetic. By representing the forget component as a low‑rank basis at each layer, Unmerge optimizes three goals—matching the merged vector, suppressing leakage, and bounding correction size—to limit forget leakage and retain damage. Experiments on ResNet‑50, ViT‑S/16, and Llama‑3.2‑3B show significant performance gains over existing methods while maintaining privacy and feature‑distribution fidelity.

By Haoran Tang, Andrew Tan, Rajiv Khanna
arXiv AI
3d ago

DISCERN: Distributional Synthetic Replay for Retain-Free Incremental Machine Unlearning

DISCERN is a class‑unlearning method that replaces real data with synthetic embeddings drawn from per‑class parametric distributions, selecting the best fit via statistical tests or cross‑validated likelihood. Unlike prototype replay, it models both Euclidean (Gaussian, Laplace, Student’s t) and directional (von Mises–Fisher, Fisher–Bingham) families to capture the latent geometry of transformer embeddings, which lie on a hypersphere. Experiments on MNIST, CIFAR‑10, and CIFAR‑100 with convolutional and transformer backbones show DISCERN performs competitively in simultaneous deletions and remains the most stable in incremental class unlearning, especially on ViT‑B/16 where it maintains a high harmonic mean after 20 sequential deletions.

By Nicol\'as Segura-Kunsagi, Juan Luis Su\'arez-D\'iaz, Iv\'an Sevillano-Garc\'ia, Francisco Herrera