arXiv AI

EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

EmbodiedCLBench is the first benchmark designed to evaluate continual learning in embodied simulation environments, focusing on self‑evolving agents. The benchmark uses compositional generalization to test whether agents can learn basic tasks and then recombine those skills to solve more complex, unseen tasks. Experiments across various agent harnesses and learning methods reveal that while basic task experience improves performance on advanced tasks, this benefit does not scale with more learning samples and current agents fail to extract additional useful information.

arXiv Machine Learning
Sep 21

Benchmarking World Models for Continual Learning on Compositional Tasks

The paper introduces a compositional continual learning benchmark for world models in robot manipulation, designed to isolate knowledge reuse from learning speed and capacity. Tasks are curated to combine previously seen action and perception components, allowing analysis of how different modalities affect reuse. Experiments show that modular world models better balance reuse and forgetting than conventional methods, yet none fully solve the challenge, highlighting the need for models explicitly built to reuse knowledge without forgetting.

By Haoyu Zhou, Joe Watson, Anson Lei, Ingmar Posner
arXiv Computation and Language
Sep 11

Self-Evolving Embodied Agents via Skill-Harness Evolution

The paper introduces SHAPER, a self‑evolving framework that enables embodied agents to adapt to new environments without retraining the underlying foundation model. SHAPER keeps model parameters frozen and instead evolves reusable skills and a context‑code harness through rollouts in the target environment, allowing the same model to act as both planner and optimizer. Experiments on VLABench and ESI‑Bench demonstrate that this skill‑and‑harness optimization outperforms pure execution, supervised fine‑tuning, and test‑time scaling baselines, showing that self‑evolving adaptation is viable when model training is costly or impractical.

By Peidong Wang, Zhiming Ma, Ying Chang, Xufang Luo, Yiqun Zhang, Zihan Wang, Xiaocui Yang, Shi Feng, Yuqing Yang, Dongsheng Li
arXiv AI
Jun 19

Playful Agentic Robot Learning

arXiv:2606. 19419v1 Announce Type: cross Abstract: Current agentic robot systems can write executable Code-as-Policy programs, observe feedback, and revise behavior across multiple attempts, but they remain largely task-driven: reusable skills are acquired only after explicit instructions.

By Junyi Zhang, Jiaxin Ge, Hanjun Yoo, Letian Fu, Zihan Yang, Yaowei Liu, Raj Saravanan, Shaofeng Yin, Justin Yu, Dantong Niu, Zirui Wang, Roei Herzig, Ken Goldberg, Yutong Bai, David M. Chan, Ion Stoica, Angjoo Kanazawa, Jiahui Lei, Haiwen Feng, Trevor Darrell
arXiv AI
Jun 3

PEAM: Parametric Embodied Agent Memory through Contrastive Internalization of Experience in Minecraft

arXiv:2605. 27762v2 Announce Type: replace Abstract: We present PEAM, a Parametric Embodied Agent Memory framework in Minecraft that transforms agent memory from inference-time retrieval into parameter-resident skills internalized through experience.

By Yuchen Guo, Junli Gong, Weicheng Wang, Hongmin Cai, Yiu-ming Cheung, Weifeng Su
arXiv Machine Learning
Jun 2

Simple Recipe Works: Vision-Language-Action Models are Natural Continual Learners with Reinforcement Learning

arXiv:2603. 11653v2 Announce Type: replace Abstract: Continual Reinforcement Learning (CRL) for Vision-Language-Action (VLA) models is a promising direction toward self-improving embodied agents that can adapt in openended, evolving environments.

By Jiaheng Hu, Jay Shim, Chen Tang, Yoonchang Sung, Bo Liu, Peter Stone, Roberto Martin-Martin