arXiv AI

From Signals to Structure: How Memory Architecture Drives Language Emergence in LLM Agents

arXiv:2607. 00233v1 Announce Type: new Abstract: How do two agents invent a shared language from scratch?

arXiv Machine Learning
Jul 10

What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents

arXiv:2607. 08032v1 Announce Type: new Abstract: Large language models, and the agents built on them, spend an ever-growing share of their compute and memory on remembering: caching attention keys and values, carrying long prompts, maintaining recurrent state, and storing what happened in previous turns and sessions.

By Ashwin Gerard Colaco, Nada Lahjouji
arXiv AI
Aug 19

Memory Is Communication: The Frontier Between Remembering and Signaling

The paper investigates how a bounded agent should allocate its limited memory and communication resources when making decisions. It defines the remembering–signaling frontier as the set of memory and message rate pairs that achieve a given performance threshold for a fixed task and decision rule. The authors hypothesize that when history can reduce task loss more, the agent will need less peer communication, and preliminary referential game experiments support this idea.

By Yashar Talebirad, Eden Redman, Ali Parsaee, Osmar R. Zaiane
arXiv AI
Jun 9

Benchmarking Open-Ended Multi-Agent Coordination in Language Agents

arXiv:2606. 08340v1 Announce Type: new Abstract: As language models are increasingly deployed as autonomous agents, they must coordinate with others over long horizons in open-ended interactive tasks.

By Kale-ab Abebe Tessera, Andras Szecsenyi, Cameron Barker, Alexander Rutherford, Davide Paglieri, Aidan Scannell, Henry Gouk, Elliot J. Crowley, Tim Rockt\"aschel, Amos Storkey
arXiv AI
Aug 24

Weighted Memory Tree: Remembering What Matters for Long-Horizon LLM Agents

The paper introduces the Weighted Memory Tree (WMT), a hierarchical memory system for large language model agents that organizes execution histories into tasks, subtasks, and actions while assigning each memory a dynamic retention score. Event-based updates and selection-based decay allow WMT to preserve useful information, fold completed trajectories, suppress low-utility content, and retain access to folded context. Experiments on GAIA-Text with Qwen3-8B, Gemma 4 E4B, and Llama-3.1-8B show that WMT improves accuracy by an average of 9.97 percentage points and reduces prompt-token usage by 32.8%, while also limiting the persistence of unreliable information.

By Quang Dao, Purvi Kathalkar, Kenneth Eaton