arXiv AI

Structured Belief State and the First Precision-Aware Benchmark for LLM Memory Retrieval

arXiv:2605. 11325v3 Announce Type: replace-cross Abstract: Current LLM memory benchmarks evaluate answer quality rather than retrieval accuracy.

arXiv Machine Learning

Jul 9

TF-Engram: A Train-Free Engram with SSD-Backed Memory for Large Language Models

arXiv:2607. 07388v1 Announce Type: cross Abstract: Large Language Models (LLMs) store factual knowledge and domain-specific patterns implicitly in dense Transformer parameters, making knowledge expansion costly through pretraining, fine-tuning, retrieval augmentation, or longer contexts.

By Yutang Ma, Kecheng Huang, Xikun Jiang, Zili Shao

llms fine-tuning efficiency

arXiv Machine Learning

Jul 13

Forget Narrowly, Retain Broadly: Unlearning as an Asymmetric Generalization Problem

arXiv:2607. 09236v1 Announce Type: new Abstract: Machine unlearning in LLMs is the targeted removal of specific knowledge while preserving all other capabilities, critical for privacy and safety.

By Amit Peleg, Naman Deep Singh, Naama Pearl, Bibhabasu Mohapatra, Matthias Hein

llms benchmarks safety

arXiv AI

Jul 29

Beyond Self-Knowledge: Propagating Uncertainty Across Reasoning and Retrieval in LLMs

arXiv:2607. 25600v1 Announce Type: cross Abstract: Retrieval-augmented generation improves knowledge-intensive question answering, but indiscriminate retrieval can introduce irrelevant evidence and unnecessary computation.

By Chandan Kumar Sah, Xiaoli Lian, Li Zhang

llms rag nlp benchmarks

arXiv AI

Jun 30

Coverage-Driven KV Cache Eviction for Efficient and Improved Inference of LLM

arXiv:2606. 29563v1 Announce Type: cross Abstract: Large language models (LLMs) excel at complex tasks like question answering and summarization, thanks to their ability to handle long-context inputs.

By Shuvendu Roy, Mengyao Zhai, Hossein Hajimirsadeghi, Golnoosh Samei

llms nlp efficiency

arXiv AI

Jun 24

CompressKV: Semantic-Retrieval-Guided KV-Cache Compression for Resource-Efficient Long-Context LLM Inference

arXiv:2606. 24467v1 Announce Type: new Abstract: Long-context large language model (LLM) inference is increasingly constrained by the memory footprint and decoding cost of key-value (KV) caches, limiting sustainable deployment on resource-constrained hardware.

By Xiaolin Lin, Jingcun Wang, Olga Kondrateva, Yiyu Shi, Bing Li, Grace Li Zhang

llms efficiency

arXiv Machine Learning

Jun 30

Diagnosing and Mitigating Retrieval Bottlenecks in LLM-Based Cold-Start Recommendation

arXiv:2606. 29947v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as rerankers in recommender systems, with the expectation that semantic understanding will help in cold-start and long-tail regimes.

By Zhe Dong (University of Maine at Presque Isle), Fang Qin (Stanford University), Manish Shah (Independent Researcher), Yicheng Wang (Independent Researcher)

llms rag benchmarks

arXiv AI

Jul 15

MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations

arXiv:2607. 12893v1 Announce Type: new Abstract: Long-term memory has become a foundational capability for LLM-based agents that accompany users across extended, multi-session interactions.

By Xixuan Hao, Zeyu Zhang, Zehao Lin, Yihang Sun, Ziliang Guo, Xichong Zhang, Yuxuan Liang, Feiyu Xiong, Zhiyu Li

llms agents nlp benchmarks

arXiv AI

Jul 28

ConsistencyGate: Preventing Memory Contamination in LLM Agents via Self-Consistency Admission Control

arXiv:2607. 22962v1 Announce Type: new Abstract: LLM agents that operate over many turns accumulate facts in an external memory store and reuse them as premises for downstream reasoning.

By Yan Zhang, Shibo Li

llms agents fine-tuning benchmarks

arXiv AI

Jul 17

When Does Belief-Based Agent Memory Help? Reliability-Conditional Updating and Provenance-Capped Poisoning Defense

arXiv:2606. 22030v2 Announce Type: replace Abstract: We investigate when belief-based memory actually improves large language model (LLM) agents.

By Pranav Singh

llms agents robotics benchmarks

arXiv AI

Jul 28

LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memory

arXiv:2607. 22690v1 Announce Type: new Abstract: Long-term memory lets LLM agents reuse past interactions, but raw dialogue histories are verbose and information-sparse.

By Jing Yu, Yibo Zhao, Jiaming Zhang, Xiang Li

llms agents reinforcement-learning fine-tuning benchmarks

arXiv Machine Learning

Jun 10

Density Field State Space Models: 1-Bit Distillation, Efficient Inference, and Knowledge Organization in Mamba-2

arXiv:2606. 10932v1 Announce Type: cross Abstract: We present Density Field State Space Models (DF-SSM), a framework for compressing SSMs to a 1-bit scaffold with int8 low-rank correction.

By Chirag Shinde

efficiency safety

Hugging Face Trending Papers

Jul 28

Beyond Self-Knowledge: Propagating Uncertainty Across Reasoning and Retrieval in LLMs

Retrieval-augmented generation improves knowledge-intensive question answering, but indiscriminate retrieval can introduce irrelevant evidence and unnecessary computation. We investigate whether verbalized confidence from black-box language models can serve as an actionable signal for retrieval routing.

llms rag nlp benchmarks

Related stories