arXiv Machine Learning By Manas Venkata Sai Ravulapalli, Samrath Singh Chadha

In-Context Binding Capacity in Language Models

Read the original on arXiv Machine Learning →

arXiv:2609. 30634v1 Announce Type: new Abstract: How many assignments can a language model recall before it loses track of which value belongs to which entity?

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jul 14

Remembering Distinct Items, Not Tokens: A Learnable Dirichlet-Process Cache Between State-Space Models and Attention

arXiv:2607. 09889v1 Announce Type: cross Abstract: Fixed-state sequence models compress an unbounded past into a bounded state, which caps their associative recall at roughly the state dimension; attention escapes the cap by keeping a key-value entry for every token, at quadratic compute and a cache that grows with the sequence.

By Siddharth Pal, Viktoria Rojkova
arXiv Computation and Language
Oct 16

From Long Context to Selective Memory:A Survey of Memory-Centric Compression for Large Language Models

The paper surveys memory‑centric compression techniques for large language models, framing long‑context handling as a memory‑management problem. It distinguishes compute‑active memory from compute‑inactive memory, and models operations such as writing, offloading, recall, and forgetting as state transitions within an information lifecycle. The authors propose a unified cost model and argue that future research should focus on dynamic, lifecycle‑aware memory management rather than static compression.

By Chaogui Gou