arXiv Machine Learning

Memoir: Should a Model Write to Its Memory While It Thinks?

arXiv:2607. 20792v1 Announce Type: new Abstract: Memoir combines per-sample fast memory, shared slow parameters, variable-depth latent recurrence, and a future-latent energy objective.

arXiv AI
Jun 24

Repeated Shared Access Enables Grokking, but Edit Propagation Depends on an Addressable Memory

arXiv:2606. 20737v2 Announce Type: replace Abstract: We study factual edit propagation in a controlled synthetic knowledge-graph QA setting using a 2x2 grid that crosses loop recurrence with shared-memory access: a dense transformer (Dense), a looped transformer (Loop), a dense backbone with shared memory (Dense+Mem), and a looped backbone with shared memory (loop-memory coupling, LMC).

By Yanan Niu