arXiv Machine Learning

Holographic Memory for Zero-Shot Compositional Reasoning in Knowledge Graphs: A Mechanistic Study of Where and Why It Fails

arXiv:2606. 24948v1 Announce Type: new Abstract: Knowledge graph embedding (KGE) models predict single-hop links well but have no mechanism for zero-shot compositional queries: multi-hop questions whose relation chains never appeared during training.

arXiv AI

Jul 7

Input Pathways Shape Few-Shot, Not Zero-Shot, Binding in Tiny Transformers: A Fully-Enumerable Study

arXiv:2607. 04926v1 Announce Type: cross Abstract: How does the way information reaches a transformer -- as symbolic tokens, a clean per-factor "oracle" code, or an entangled perceptual vector -- shape whether it binds that information compositionally?

By Yoshiyuki Ootani

llms safety

arXiv AI

Jun 26

Retrieval-Warmed Energy-Based Reasoning: A Five-Arm Ablation Methodology for Diffusion-as-Inference on Structured Reasoning Tasks

arXiv:2606. 26476v1 Announce Type: cross Abstract: Warm-started diffusion samplers accelerate iterative inference, but it is rarely clear which part of the pipeline carries the gain.

By Libo Sun, Po-Wei Harn, Zewei Zhang, Peixiong He, Xiao Qin

llms rag diffusion benchmarks safety

arXiv AI

Jul 2

DiscoLoop: Looping Discrete Embeddings and Continuous Hidden States for Multi-hop Reasoning

arXiv:2607. 00341v1 Announce Type: cross Abstract: Large language models achieve strong performance on many reasoning tasks when allowed to externalize intermediate steps as Chain-of-Thought (CoT).

By Hengyu Fu, Tianyu Guo, Zixuan Wang, Hanlin Zhu, Jason D. Lee, Jiantao Jiao, Stuart Russell, Song Mei

llms rag benchmarks

arXiv Machine Learning

2d ago

You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model

arXiv:2608. 14465v1 Announce Type: cross Abstract: A frozen language model on reasoning tasks has two coupled weaknesses: it under-uses evidence its own residual stream already encodes, and it fails to detect when the input is insufficient to answer, so it confabulates.

By Ziyang Luo, Zhongyao Chu, Xinjie He, Youting Wang, Xukui Qin, Runxiong Wu, Yan-Syuan Chen

llms benchmarks

arXiv Machine Learning

Jul 1

Explicit Fuzzy Logic in the Feed-Forward Layer: Self-Forgetting Quantifiers Discover Legible Grammatical-Licensing Detectors

arXiv:2606. 31845v1 Announce Type: cross Abstract: A transformer's feed-forward (FFN) sublayer materializes the distinctions attention gathers, yet gives no account of what it computes.

By Mark Oskin

llms

arXiv AI

Jul 23

Profile-Graph Memory for LLM Agents: Implicit Cross-Entity Traversal through Narrative Profiles

arXiv:2607. 19359v1 Announce Type: new Abstract: Long-term memory is essential for LLM agents that interact across sessions, yet current memory benchmarks primarily evaluate single-hop recall, leaving multi-hop association largely unmeasured.

By Shengtong Zhu

llms rag agents benchmarks

arXiv Machine Learning

Jun 4

Training-Free Lexical-Dense Fusion for Conversational-Memory Retrieval

arXiv:2606. 04194v1 Announce Type: new Abstract: Retrieving the few past turns that answer a new query across long multi-session histories is the retrieval bottleneck behind long-term conversational memory (LoCoMo, LongMemEval).

By Christian Lysenst{\o}en

rag benchmarks safety

arXiv AI

Jun 2

Don't Ask the LLM to Track Freshness: A Deterministic Recipe for Memory Conflict Resolution

arXiv:2606. 01435v1 Announce Type: new Abstract: LLM-based memory systems increasingly maintain facts that evolve over time, where a recurring failure is conflict resolution: when a fact has multiple contradictory values, which should the agent return?

By Vikas Reddy, Sumanth Challaram

llms rag agents

arXiv AI

Jun 9

Why Limit the Residual Stream to Layers and Not Tokens? Persistent Memory for Continuous Latent Reasoning

arXiv:2606. 07720v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated remarkable reasoning abilities on mathematical and multi-hop planning tasks.

By Mujtaba Farhan, Maheep Chaudhary

llms diffusion

arXiv AI

Jun 30

Query-Aware Spreading Activation for Multi-Hop Retrieval over Knowledge Graphs

arXiv:2606. 30133v1 Announce Type: cross Abstract: Retrieval-augmented generation built on knowledge graphs (Graph RAG) outperforms flat passage retrieval on multi-hop question answering by leveraging graph structure.

By Illia Makarov, Mykola Glybovets

rag diffusion nlp benchmarks

arXiv Machine Learning

Jun 15

Recipe-Controlled Decoder Audit for Structural Knowledge-Graph Completion

arXiv:2606. 14492v1 Announce Type: new Abstract: We present a recipe-controlled decoder audit (RCDA) for structural transductive knowledge-graph completion (KGC).

By Xihang Shan, Ye Luo

benchmarks

arXiv AI

Jul 14

The Equilibrium Is the Initialization: Lazy Identity Collapse in Physics-Structured Deep Equilibrium Reasoning

arXiv:2607. 11116v1 Announce Type: cross Abstract: Deep equilibrium models promise input-adaptive implicit computation: harder problems should demand more solver iterations, and the solved equilibrium should encode the result of genuine iterative inference.

By Joyjeet Singh

rag benchmarks

Related stories