arXiv AI
MegaMem: A Retrieval Solution for Ultra-Large Context Windows
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Sep 11
REVA: Reusable Evidence View Aggregation for Context-Efficient RAG Serving
The paper introduces REVA, a method for compressing retrieval-augmented generation (RAG) prompts by aggregating historical query–document–model interactions into reusable evidence views. REVA mines attention traces from the target generator, maps token-level attention to readable words, aggregates importance across repeated document accesses, and produces budget‑specific plain‑text views that maintain document order and the standard RAG interface. Experiments on four benchmarks with modern LLMs show that REVA improves generation quality by 1.0–5.8 points over existing compressors while reducing compression overhead by 5.3 to 15.6 times and adding less than 40 ms of latency.
arXiv Computation and Language
Sep 15
Where to Look and What to Use: Retrieve-Localize-Generate for Long-Term Conversational Memory Question Answering
arXiv:2609.07093v2 Announce Type: replace Abstract: Retrieval-augmented generation (RAG) enables large language models (LLMs) to answer questions by accessing external knowledge and has been widely a...
arXiv AI
Jun 30
HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoning
arXiv:2606. 28349v1 Announce Type: cross Abstract: Long-context reasoning requires models to access, retrieve, and integrate evidence scattered across documents, dialogues, and accumulated interaction histories.
arXiv AI
4d ago
Memorilla: Latent Semantic Memory for LLMs
Memorilla is a memory system that encodes an entire document collection into reusable embeddings and retrieves query‑specific information as a fixed set of memory tokens for a frozen large language model. Using only 16 memory tokens, it outperforms baselines such as Mem0 and MemoRAG on most benchmarks, achieving higher accuracy on FactKG while drastically reducing token usage. In agentic settings, Memorilla helps prevent wandering and boosts success rates in a TextWorld environment, demonstrating its utility for continual learning and long‑context interactions.
arXiv Computation and Language
Oct 7
Memory Depth and Reconstructed Context Width: A Controlled Evaluation of Hierarchical Retrieval
arXiv:2610.08300v1 Announce Type: new Abstract: Long-term conversational memory is becoming an integral component of modern LLM systems. Proposed architectures group records by topics and events, con...
arXiv AI
Jun 12
MemRefine: LLM-Guided Compression for Long-Term Agent Memory
arXiv:2606. 13177v1 Announce Type: cross Abstract: Large language model (LLM) agents are increasingly expected to operate over long-term interactions, where information from past dialogues must be preserved and recalled to support future tasks.