The Flow has not summarised this story yet — read it at arXiv Computation and Language.
UTILMEM is a new diagnostic benchmark that tests how conversational agents use long‑term memory, focusing on reasoning over dense histories, spotting implicitly relevant memories, synthesizing distributed evidence, and resisting interference from similar distractors. It contains 1,717 instances across five domains and evaluates a range of retrieval‑based and memory‑augmented systems. The study shows that strong performance on traditional factual recall does not guarantee effective memory utilization, highlighting a gap between retrieving information and integrating it into coherent, task‑oriented outputs.
arXiv:2607. 12893v1 Announce Type: new Abstract: Long-term memory has become a foundational capability for LLM-based agents that accompany users across extended, multi-session interactions.
The paper introduces T‑Mem, a memory framework that uses temporal structure to manage long‑horizon multi‑party conversations. It employs Temporal Evidence Discovery to find locally concentrated evidence, Temporal Memory Structuring to model state transitions and compress low‑information spans, and Evidence Forest Linearization to serialize the evidence for answer generation. Experiments on two benchmarks show that T‑Mem outperforms existing memory frameworks across various settings.
arXiv:2608. 03463v1 Announce Type: new Abstract: Long-term memory is essential for LLM-based agents to sustain interactions and reliably leverage distant history.
JustMem is a new memory system for long‑term conversational AI that stores conversation history as compact atomic memories and adapts its access strategy to each query. It introduces two dimensions of memory access—discovery breadth and reading fidelity—implemented through LOOKUP for local evidence, COMPOSE for distributed evidence, and REPLAY for fidelity‑sensitive evidence. Experiments on LoCoMo and LongMemEval‑S show that JustMem outperforms competing memory systems in accuracy and recall while using fewer generative‑model tokens for memory construction and inference.
The paper introduces Chain on Demand (CoD), a query‑time evidence organization framework that builds a temporary evidence chain from an unchanged turn‑level memory. CoD allocates a fixed anchor budget based on query relevance, lexical diversity, and new query terms, then restores each anchor’s same‑session neighborhood deterministically. In evaluations on LoCoMo and LongMemEval‑S, CoD achieves high accuracy, demonstrating that long‑term conversational memory can remain unchanged while deferring evidence organization until the query is known.