EmbodiedRSI is a self‑evolving agentic harness that autonomously selects physical experiments to refine robot code and skills, using a Fast‑Slow Dual‑System Architecture and a Hypothesis Graph. It employs Value‑of‑Information Experiment Selection to distinguish competing hypotheses, guiding Code‑Skill Co‑Evolution, while the Slow System builds Hierarchical Memory and Reward‑Grounded Memory Learning to improve future Fast‑System performance. On RoboCasa365 and LIBERO‑Pro benchmarks, EmbodiedRSI achieves markedly higher success rates than baselines and demonstrates zero‑shot transfer to real‑world robots, achieving 71.3% overall success across multiple challenging tasks.
By Python Song, Zhixuan Liang, Kelsey Fu, Mengdi Wang, Junfeng Yang, Shilong Liu
arXiv:2610.18792v1 Announce Type: cross
Abstract: Frontier language-model agents can now improve robots on their own: they write control code, test it, and keep what works as skills and memories for...
By Xinyi Wang, Bangzheng Li, Hanyu Wang, Lin Zhang, Andrea Yaoyun Cui, Zhenggang Tang, Shyamal Buch, Dejia Xu
Robot foundation models provide strong visuomotor control, yet their performance can degrade when object positions or task instructions change. Further improvements often require post-training on subs...
arXiv:2606. 19419v1 Announce Type: cross Abstract: Current agentic robot systems can write executable Code-as-Policy programs, observe feedback, and revise behavior across multiple attempts, but they remain largely task-driven: reusable skills are acquired only after explicit instructions.
By Junyi Zhang, Jiaxin Ge, Hanjun Yoo, Letian Fu, Zihan Yang, Yaowei Liu, Raj Saravanan, Shaofeng Yin, Justin Yu, Dantong Niu, Zirui Wang, Roei Herzig, Ken Goldberg, Yutong Bai, David M. Chan, Ion Stoica, Angjoo Kanazawa, Jiahui Lei, Haiwen Feng, Trevor Darrell
arXiv:2610.20474v1 Announce Type: new
Abstract: Pretrained vision-language-action models (VLAs) often fail midway through unseen long-horizon tasks. Recursive self-improvement (RSI) offers a remedy,...
By Peidong Wang, Ying Chang, Zhiming Ma, Xiaocui Yang, Shi Feng, Daqi Liu, Yuzhe Yang, Xu Cao, Chuang Wang, Jian Su, Daling Wang
The paper introduces the Embodied First Exam, a comprehensive evaluation framework for coding agents to control robots across diverse tasks and settings. It includes 1,156 tasks on 47 robots, spanning new domains such as spatial puzzles and multi-robot interaction, and offers three evaluation modes: Standard, Realtime, and Privileged. In the Standard setting, the best agent (GPT‑6 Astra in Codex) achieves only 34% success, highlighting significant room for improvement.
Flex‑RSI is a new benchmark that evaluates how agents can recursively improve their own harness—prompts, tools, memory, and control loop—while solving vision and robotics tasks under a fixed budget. Each round alternates between an executor that refines the task solution and an improver that revises the harness, with only higher‑scoring solutions retained for the next iteration. The benchmark tests both closed‑source and open‑weight models across perception, reasoning, robot action, 3D reconstruction, visual creation, and infrastructure tasks, revealing that self‑improvement is most effective when agents build their own solutions, that simple success/failure feedback limits open‑weight models, and that harness editing itself contributes significantly to performance gains.
By Jingdong Zhang, Jionghao Wang, Zhengming Yu, Yancheng Cai, Wei Chow, Chris Choy, Zhiyang Dou, Hang Hua, Jiachen Li, Zhixuan Liu, Chen Wang, Songlin Wei, Siyuan Yang, Yu Yuan, Xiaohang Zhan, Yucheng Zhang, Shuhong Zheng, Xin Li, Lingjie Liu, Wojciech Matusik, Zhengzhong Tu, Wenping Wang
SO-101 Bench is a simulated benchmark for language‑conditioned spatial manipulation on the low‑cost SO‑101 robotic arm, built using an Isaac Lab digital twin of a real setup. It features four tasks across five families, 138 objects with seen/unseen splits, 916 evaluation episodes, and 3,629 simulated demonstrations for policy fine‑tuning. The benchmark’s rankings mirror real‑world performance (Spearman ρ = 1.00) and reveals that while learned policies reach about 61% success, an LLM‑driven agent that writes code and delegates grasping achieves 83.2%.
By Truman Hickok
EmbodiedCLBench is the first benchmark designed to evaluate continual learning in embodied simulation environments, focusing on self‑evolving agents. The benchmark uses compositional generalization to test whether agents can learn basic tasks and then recombine those skills to solve more complex, unseen tasks. Experiments across various agent harnesses and learning methods reveal that while basic task experience improves performance on advanced tasks, this benefit does not scale with more learning samples and current agents fail to extract additional useful information.
By Jie Huang, Yanan Chen, Ruixun Liu, Kaichen He, Xinyi He, Rui Huang, Zilong Zheng, Zhenliang Zhang, Yiwu Zhong
arXiv:2605. 10332v2 Announce Type: replace Abstract: Embodied agents can benefit from skills that guide object search, action execution, and state changes across diverse environments.
By Ruofei Ju, Xinrui Wang, Xin Ding, Yifan Yang, Hao Wu, Shiqi Jiang, Qianxi Zhang, Hao Wen, Xiangyu Li, Weijun Wang, Kun Li, Yunxin Liu, Haipeng Dai, Wei Wang, Ting Cao
Teach-and-Grow Learning (TGL) is an agent-centered architecture that transforms a few successful demonstrations into reusable Skill Blocks, enabling a robot to compose, execute, and revise behaviors in new scenes without task-specific policy retraining. The system maintains a Skill Library and structured Experience Memory to capture successes, failures, and repairs, allowing persistent reuse and agent-directed adaptation. Evaluation on the LIBERO benchmark shows state-of-the-art performance, and the authors propose a scaling-law hypothesis suggesting that accumulated reusable experience reduces future-task error and teaching demand following a power-law trend.
By Chang Nie, Zhe Liu, Hesheng Wang
arXiv:2609.37359v1 Announce Type: cross
Abstract: Coding agents can now write, run, and debug programs with little human help. Robot tasks, however, are usually specified by a sentence that leaves ou...
By Yifan Kang, Zihan Wang, Zhiwen Fan, Bangya Liu