arXiv AI By R\'ois\'in Luo, Christian Gagn\'e, Jonas Ngnaw\'e, Ihsan Ullah, Karyn Morrissey

A Stochastic--Geometric Theory of Scaling Laws in Grokking

Read the original on arXiv AI →

arXiv:2606. 30388v1 Announce Type: cross Abstract: Delayed generalization (\ie~grokking) refers to the phenomenon in which a neural network fits its training data early in training but only begins to generalize after a prolonged delay, often through an abrupt transition.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.