arXiv AI By Jie Huang, Yanan Chen, Ruixun Liu, Kaichen He, Xinyi He, Rui Huang, Zilong Zheng, Zhenliang Zhang, Yiwu Zhong

EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

Read the original on arXiv AI →

EmbodiedCLBench is the first benchmark designed to evaluate continual learning in embodied simulation environments, focusing on self‑evolving agents. The benchmark uses compositional generalization to test whether agents can learn basic tasks and then recombine those skills to solve more complex, unseen tasks. Experiments across various agent harnesses and learning methods reveal that while basic task experience improves performance on advanced tasks, this benefit does not scale with more learning samples and current agents fail to extract additional useful information.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 21

Benchmarking World Models for Continual Learning on Compositional Tasks

The paper introduces a compositional continual learning benchmark for world models in robot manipulation, designed to isolate knowledge reuse from learning speed and capacity. Tasks are curated to combine previously seen action and perception components, allowing analysis of how different modalities affect reuse. Experiments show that modular world models better balance reuse and forgetting than conventional methods, yet none fully solve the challenge, highlighting the need for models explicitly built to reuse knowledge without forgetting.

By Haoyu Zhou, Joe Watson, Anson Lei, Ingmar Posner
arXiv Computation and Language
Sep 11

Self-Evolving Embodied Agents via Skill-Harness Evolution

The paper introduces SHAPER, a self‑evolving framework that enables embodied agents to adapt to new environments without retraining the underlying foundation model. SHAPER keeps model parameters frozen and instead evolves reusable skills and a context‑code harness through rollouts in the target environment, allowing the same model to act as both planner and optimizer. Experiments on VLABench and ESI‑Bench demonstrate that this skill‑and‑harness optimization outperforms pure execution, supervised fine‑tuning, and test‑time scaling baselines, showing that self‑evolving adaptation is viable when model training is costly or impractical.

By Peidong Wang, Zhiming Ma, Ying Chang, Xufang Luo, Yiqun Zhang, Zihan Wang, Xiaocui Yang, Shi Feng, Yuqing Yang, Dongsheng Li