arXiv Machine Learning
Sep 21

Benchmarking World Models for Continual Learning on Compositional Tasks

The paper introduces a compositional continual learning benchmark for world models in robot manipulation, designed to isolate knowledge reuse from learning speed and capacity. Tasks are curated to combine previously seen action and perception components, allowing analysis of how different modalities affect reuse. Experiments show that modular world models better balance reuse and forgetting than conventional methods, yet none fully solve the challenge, highlighting the need for models explicitly built to reuse knowledge without forgetting.

By Haoyu Zhou, Joe Watson, Anson Lei, Ingmar Posner
arXiv Machine Learning
Nov 2

When the Past Shapes Action: Understanding Embodied Memory

The paper "When the Past Shapes Action: Understanding Embodied Memory" surveys how embodied AI agents can preserve and use past observations, actions, and experiences to improve decision-making in dynamic environments. It categorizes existing approaches along six memory requirements—world-state persistence, task progress, belief maintenance, experiential learning, etc.—and eight architectural styles such as recurrent states, fast weights, and spatial memory. The authors evaluate how current benchmarks test memory-dependent behavior and highlight open challenges in selecting relevant experiences, maintaining consistent beliefs, and consolidating knowledge across episodes.

By Siqi Li, Ziyi Bai, Xinrun Xu, Tinglei Huang, B\"orje F. Karlsson