arXiv Machine Learning
The Rules-and-Facts Model for Simultaneous Generalization and Memorization in Neural Networks
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jul 14
Random Label Prediction Heads for Studying Memorization in Deep Neural Networks
arXiv:2607. 11541v1 Announce Type: new Abstract: We introduce a straightforward yet effective method to empirically study memorization in deep neural networks for classification tasks.
arXiv Machine Learning
Jul 24
Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
arXiv:2510. 24616v4 Announce Type: replace-cross Abstract: For four decades statistical physics has been providing a framework to analyse neural networks.
arXiv Machine Learning
Jul 16
Local Redundancy: An Information-Theoretic Measure of Plasticity from Synthetic Memorization
arXiv:2607. 13432v1 Announce Type: new Abstract: Plasticity -- a neural network's ability to adapt to new tasks -- is critical for continual and transfer learning.
arXiv Machine Learning
4d ago
Reference-Guided Machine Unlearning
Reference-Guided Machine Unlearning (ReGUn) is a vision unlearning framework that prioritizes distributional indistinguishability over degradation-based heuristics. It uses disjoint held-out data to create a class-conditioned reference distribution for distillation, guiding forget samples toward non-member behavior without explicitly degrading predictions. Experiments across various architectures and datasets show that ReGUn achieves a competitive forgetting–utility trade-off and closely matches retrain-like membership inference behavior.
arXiv Computer Vision
Sep 1
Knowing Beyond the Known: Reinforced Knowledge Specification for Multi-Label Class-Incremental Learning
arXiv:2608.30316v1 Announce Type: new Abstract: Existing class-incremental learning methods struggle in multi-label scenarios (MLCIL) due to the inherent contradiction of learning objectives arising...
arXiv Machine Learning
Aug 3
The Grokked Illusion: True Equilibrium Mitigates Catastrophic Forgetting
arXiv:2607. 29503v1 Announce Type: new Abstract: While neural networks are typically evaluated by their training and test performance, these metrics do not reveal how robust a learned representation is.