arXiv AI By Python Song, Zhixuan Liang, Kelsey Fu, Mengdi Wang, Junfeng Yang, Shilong Liu

EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolution

Read the original on arXiv AI →

EmbodiedRSI is a self‑evolving agentic harness that autonomously selects physical experiments to refine robot code and skills, using a Fast‑Slow Dual‑System Architecture and a Hypothesis Graph. It employs Value‑of‑Information Experiment Selection to distinguish competing hypotheses, guiding Code‑Skill Co‑Evolution, while the Slow System builds Hierarchical Memory and Reward‑Grounded Memory Learning to improve future Fast‑System performance. On RoboCasa365 and LIBERO‑Pro benchmarks, EmbodiedRSI achieves markedly higher success rates than baselines and demonstrates zero‑shot transfer to real‑world robots, achieving 71.3% overall success across multiple challenging tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 2

ASPIRE: Agentic /Skills Discovery for Robotics

arXiv:2607. 00272v1 Announce Type: cross Abstract: Traditional robot programming is challenging: it requires orchestrating multimodal perception, managing physical contact dynamics, and handling diverse configurations and execution failures.

By Runyu Lu, Yubo Wu, Ethan Kou, Letian Fu, Wenli Xiao, Ajay Mandlekar, Yinzhen Xu, Guanya Shi, Ken Goldberg, Ang Chen, Mosharaf Chowdhury, Yuke Zhu, Linxi "Jim" Fan, Guanzhi Wang
arXiv AI
Jun 19

Playful Agentic Robot Learning

arXiv:2606. 19419v1 Announce Type: cross Abstract: Current agentic robot systems can write executable Code-as-Policy programs, observe feedback, and revise behavior across multiple attempts, but they remain largely task-driven: reusable skills are acquired only after explicit instructions.

By Junyi Zhang, Jiaxin Ge, Hanjun Yoo, Letian Fu, Zihan Yang, Yaowei Liu, Raj Saravanan, Shaofeng Yin, Justin Yu, Dantong Niu, Zirui Wang, Roei Herzig, Ken Goldberg, Yutong Bai, David M. Chan, Ion Stoica, Angjoo Kanazawa, Jiahui Lei, Haiwen Feng, Trevor Darrell
arXiv Computer Vision
Nov 2

RoboArchitect: Automating the Design of Robotic Agents with Persistent Memory

RoboArchitect automates the design of agent harnesses that orchestrate frozen robot policies, vision tools, and direct arm commands. By observing rollouts, diagnosing failures, and iteratively revising the harness, it improves success rates from 9.7% to 43.3% on unseen scenes and from 12.7% to 40.2% on unseen tasks without updating model weights. The evolved harness also develops persistent memory and intuitive control strategies, outperforming finetuned policies especially when the benchmark diverges from the policy’s training data.

By Shengguang Wu, Suning Huang, Cherie Ho, Ria Doshi, Hao Zhu, Serena Yeung-Levy
arXiv AI
Oct 12

EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

EmbodiedCLBench is the first benchmark designed to evaluate continual learning in embodied simulation environments, focusing on self‑evolving agents. The benchmark uses compositional generalization to test whether agents can learn basic tasks and then recombine those skills to solve more complex, unseen tasks. Experiments across various agent harnesses and learning methods reveal that while basic task experience improves performance on advanced tasks, this benefit does not scale with more learning samples and current agents fail to extract additional useful information.

By Jie Huang, Yanan Chen, Ruixun Liu, Kaichen He, Xinyi He, Rui Huang, Zilong Zheng, Zhenliang Zhang, Yiwu Zhong