arXiv AI By Zirong Song, Zheng Lu, Haoran Liao, Wanqi Zhong, Yunhe Ni, Lijie Wang, Xiuying Chen

RIFAR: Reliability and Forgetting-Aware Replay for Continual Robot Learning

Read the original on arXiv AI →

RIFAR is a new continual learning method for robots that uses reliability screening and drift-aware replay to mitigate forgetting while keeping storage low. It reconstructs past trajectories from short demonstration prefixes and employs a frozen inverse-dynamics model to verify action‑visual consistency. In experiments on LIBERO suites and real‑world tasks, RIFAR outperforms previous generative replay approaches, achieving high performance with only a small fraction of stored steps.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
3d ago

Rewind-IL: Online Failure Detection and State Respawning for Imitation Learning

Rewind-IL is a training‑free online safeguard for generative action‑chunked imitation learning policies. It uses a zero‑shot failure detector based on Temporal Inter‑chunk Discrepancy Estimate (TIDE) and a state‑respawning mechanism that returns the robot to a verified safe intermediate state. The system builds a checkpoint library offline with a vision‑language model and monitors self‑consistency online, rewinding execution to the latest safe checkpoint when a failure is detected, thereby improving reliability in long‑horizon manipulation tasks.

By Gehan Zheng, Sanjay Seenivasan, Matthew Johnson-Roberson, Weiming Zhi
arXiv Machine Learning
Sep 17

Characterizing Replay Retention Under Dynamics Shift in Model-Based Reinforcement Learning

The paper investigates how to balance retaining past experience versus learning from new data when robot dynamics change. It introduces two metrics—change magnitude and age‑staleness AUC—to quantify when older transitions are helpful or harmful. Experiments on locomotion tasks and real‑world perturbations show that the optimal replay strategy depends on the size of the dynamics shift and the evolution of the system over time.

By Everest Yang, Skye Thompson, George D. Konidaris
arXiv Machine Learning
Sep 21

Benchmarking World Models for Continual Learning on Compositional Tasks

The paper introduces a compositional continual learning benchmark for world models in robot manipulation, designed to isolate knowledge reuse from learning speed and capacity. Tasks are curated to combine previously seen action and perception components, allowing analysis of how different modalities affect reuse. Experiments show that modular world models better balance reuse and forgetting than conventional methods, yet none fully solve the challenge, highlighting the need for models explicitly built to reuse knowledge without forgetting.

By Haoyu Zhou, Joe Watson, Anson Lei, Ingmar Posner
arXiv AI
5d ago

F4R: Failure-Driven Recognition, Reconstruction, Refinement, and Redeployment for Continual Robot Self-Improvement

arXiv:2609.35575v2 Announce Type: replace-cross Abstract: The real-world performance of current vision-language-action models is fundamentally constrained by the limited coverage of expert demonstrat...

By Zhuoyuan Yu, Jiacheng Wang, Tianle Liu, Yihua Ren, Peng Yu, Chen Bai, Ziheng Zhang, Yufei Jia, Jindou Jia, Yuhang Zhang, Xinrui Zhang, Shang Yujing, Yuxiang Chen, Chuhao Zhou, Tiancai Wang, Jianfei Yang