arXiv Machine Learning By Radha Poovendran, Andrea Stocco, Linda Bushnell

AIBL: Augmented Instance-Based Learning with Structured Memory and Neural Embeddings

Read the original on arXiv Machine Learning →

AIBL (Augmented Instance-Based Learning) extends traditional Instance-Based Learning Theory by embedding high‑dimensional sequential data into a learned vector space, enabling neural similarity matching while preserving instance storage, activation‑weighted retrieval, and utility blending. The model introduces structured memory stores—active, forgotten, and surprise—to manage novelty detection and concept drift, promoting frequently surprising instances into active memory. Experiments on five machine‑learning tasks and three simulations show that AIBL outperforms classical IBLT variants and task‑specific baselines, improving accuracy by 6 to 17 percentage points.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language
Oct 12

Beyond the Final Embedding: Retrieving Memories from Token-Level Evidence

The paper introduces a memory-augmented retrieval method that leverages token-level evidence instead of relying solely on single-vector embeddings. By performing sparse token matching and aggregating scores with whole-memory similarity, the approach improves retrieval performance across eight benchmarks and various model families without extra training. An optional low-rank query adapter can further boost results when supervised.

By Han Luo, Zhan Zhuang, Xu He, Jujia Zhao, Yu Li, Suqin Yuan, Dong Li, Lei Feng
arXiv Computation and Language
Oct 9

Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendation

The paper introduces MARI, a Memory-Augmented Recommendation system that uses a Decision Memory Bank to store Structured Decision Memories (SDMs) capturing users’ goals, constraints, and trade-offs. Unlike prior methods that flatten heterogeneous behaviors into token sequences, MARI retrieves relevant SDMs to enhance LLM reasoning, improving performance on next-item prediction and a new Difficult Choice Prediction task while keeping latency low. The approach also provides interpretable, human-readable insights into user decision-making.

By Leikun Liang, Guoshuai Wang, Xingsheng He, Yushan Han, Yunyi Xuan, Xiaoxiao Xu, Lin Qu
arXiv AI
Aug 18

Learning from Unreachable Rewards: Hint-Conditioned Reinforcement Learning for Generative Recommendation

arXiv:2608. 11980v2 Announce Type: replace-cross Abstract: Semantic-ID generative recommenders represent each item as a short sequence of discrete semantic tokens and predict the next item by autoregressively generating this token sequence.

By Kangning Zhang, Haotian Fang, Xukun Luo, Hao Yin, Yang Gao, Peng Yan, Weiwen Liu, Weinan Zhang, Yong Yu
arXiv AI
Aug 18

QUMem: Personalized Memory for Query-Conditioned User-State Inference in LLM Agents

arXiv:2608. 16168v1 Announce Type: cross Abstract: Large language model (LLM) agents increasingly use external memory systems to support personalization by drawing on long and evolving interaction histories, in which user preferences may be distributed across time, change with context, and conflict with earlier evidence.

By Heng Wang, Yifei Li, Lingling Zhang, Pengyu Li, Xinyu Che, Xinyu Zhang, Zesheng Yang