Continual Policy Consolidation for Lifelong Robot Learning
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2610.18596v1 Announce Type: cross Abstract: Reinforcement learning (RL) post-training improves robot foundation models (RFMs) beyond their demonstrations, but real-world deployment demands more...
ACCRUE is a continual off‑policy reinforcement learning framework designed for robot foundation models. It keeps lightweight actor and critic networks across tasks, reusing behavioral and value knowledge from previous RL stages while preserving prior behavior through actor distillation on a small set of retained episodes. Experiments on contact‑rich assembly tasks in simulation and on real robots show that ACCRUE speeds up learning of new tasks, nearly eliminates forgetting, and cuts real‑robot training time by 31.0% to 68.5%.
arXiv:2606. 26183v1 Announce Type: cross Abstract: Building a generalist robot that can leverage prior knowledge for continuous task adaptation remains a significant challenge.
arXiv:2606. 03598v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have achieved remarkable success in language-conditioned robotic manipulation.
Teach-and-Grow Learning (TGL) is an agent-centered architecture that transforms a few successful demonstrations into reusable Skill Blocks, enabling a robot to compose, execute, and revise behaviors in new scenes without task-specific policy retraining. The system maintains a Skill Library and structured Experience Memory to capture successes, failures, and repairs, allowing persistent reuse and agent-directed adaptation. Evaluation on the LIBERO benchmark shows state-of-the-art performance, and the authors propose a scaling-law hypothesis suggesting that accumulated reusable experience reduces future-task error and teaching demand following a power-law trend.
RIFAR is a new continual learning method for robots that uses reliability screening and drift-aware replay to mitigate forgetting while keeping storage low. It reconstructs past trajectories from short demonstration prefixes and employs a frozen inverse-dynamics model to verify action‑visual consistency. In experiments on LIBERO suites and real‑world tasks, RIFAR outperforms previous generative replay approaches, achieving high performance with only a small fraction of stored steps.