arXiv AI

RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments

RoboRSI is a robot self‑improvement system that uses Top‑Down Skill Refinement to decompose tasks into compound, atomic, and base skills with clear responsibilities and input‑output contracts. The system coordinates a Manager, Planner, Engineer, and Reviewer to plan, execute, diagnose, and validate skill revisions, allowing humans to guide objectives and corrections. On a mobile manipulator, RoboRSI successfully learns multi‑object household cleanup over 104 rounds and outperforms the strongest baseline by 2.7 to 11.0 percentage points on several simulation benchmarks.

arXiv AI
Jul 2

ASPIRE: Agentic /Skills Discovery for Robotics

arXiv:2607. 00272v1 Announce Type: cross Abstract: Traditional robot programming is challenging: it requires orchestrating multimodal perception, managing physical contact dynamics, and handling diverse configurations and execution failures.

By Runyu Lu, Yubo Wu, Ethan Kou, Letian Fu, Wenli Xiao, Ajay Mandlekar, Yinzhen Xu, Guanya Shi, Ken Goldberg, Ang Chen, Mosharaf Chowdhury, Yuke Zhu, Linxi "Jim" Fan, Guanzhi Wang
arXiv AI
Jun 19

ENPIRE: Agentic Robot Policy Self-Improvement in the Real World

arXiv:2606. 19980v1 Announce Type: new Abstract: Achieving dexterous robotic manipulation in the real world heavily relies on human supervision and algorithm engineering, which becomes a central bottleneck in the pursuit of general physical intelligence.

By Wenli Xiao, Jia Xie, Tonghe Zhang, Haotian Lin, Letian "Max" Fu, Haoru Xue, Jalen Lu, Yi Yang, Cunxi Dai, Zi Wang, Jimmy Wu, Guanzhi Wang, S. Shankar Sastry, Ken Goldberg, Linxi "Jim" Fan, Yuke Zhu, Guanya Shi
arXiv AI
Oct 1

Make Code as Policy Great Again: Frontier Agents Write, Call, and Evolve Robot Tools

The paper introduces URAI, a Universal Robot‑Agent Interface that separates robot control into two roles: a programming agent that writes reusable, task‑specific tools from intent, and an execution agent that calls these tools in a feedback loop. This design keeps high‑level decision making in the model while delegating low‑level motion to code, allowing tool revisions to persist across episodes without retraining the foundation model. Experiments on RoboDojo and AgileX tasks show significant gains in success rate, speed, and token efficiency compared to direct fingertip control and pre‑written programs.

By Shijia Ge, Alex Zhou, Jianshu Zeng, Yexing Wan, Di Wu, Zelin Zheng, Yazhe Wang, Zhiqi Jia, Xuan Shangguan, Jay Zhu, Yijun Liu, Lingyu He, Sihang Wu, Xiao He, Hongcheng Gao
arXiv AI
Oct 2

Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents

Reconstruct, Practice, Go Real (RPG) is a framework that enables autonomous improvement of robot execution systems without updating model weights. RPG identifies manipulation capabilities from offline data, creates simulation practice tasks, and uses feedback to diagnose failures, develop new symbolic skills, refine existing ones, and revise the system prompt. Across 22 manipulation tasks, RPG raises task success from 28.6% after the first practice round to 95.0% after 15 rounds, outperforming baselines and achieving perfect success on 30 physical trials after calibration.

By Yen-Jen Wang, Haozhe Jiang, Shuying Deng, Haoru Xue, Weirui Ye, Rocky Duan, Nika Haghtalab, S. Shankar Sastry, Pieter Abbeel, Haozhi Qi
arXiv AI
Sep 18

From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation

The paper introduces HALTER, a graph-based system that automates the reset and evaluation of long-horizon robot manipulation tasks. HALTER constructs a spatial scene graph from point clouds and vision models, uses an LLM to score rollouts, plan resets, and verify success, all without labeled success images. In experiments on a Franka arm, HALTER restores scenes in 76% of episodes, improves skill completion estimation, and reduces operator time by 72% compared to manual reset.

By Jing Jiang, Yue Yang, Xinkai Jiang, Gedas Bertasius, Daniel J. Szafir, Rudolf Lioutikov
arXiv Computer Vision
Oct 8

CIRRA: Dual-Level Continual Instruction Reconciliation with Ongoing Execution for Embodied Robot Agents in Interactive Household Tasks

arXiv:2610.08862v1 Announce Type: cross Abstract: Household robots must accommodate new user instructions while executing ongoing tasks. Existing agents often regenerate or extensively revise the rem...

By Ci Zhang, Enfu Nan, Arman Akbari, Lin Zhao, Li Wang, Chen Wang, Weiwei Chen, Yanzhi Wang, Geng Yuan
arXiv Computation and Language
4d ago

OmniBrain-0: A Unified Agentic Model for Embodied Intelligence

OmniBrain-0 is a lightweight, unified embodied agent that coordinates manipulation and navigation through a shared high‑level decision model. It integrates task understanding, planning, progress tracking, and feedback‑driven recovery, and is trained via embodied pretraining, domain‑specialized agent distillation, and multi‑teacher on‑policy distillation. The framework also introduces Rubric‑Guided Recursive Self‑Improvement, a data flywheel that refines rubrics and trajectories for continual domain‑expert updates, enabling efficient transfer and consolidation of embodied capabilities across multiple benchmarks and real‑world tasks.

By Xiaomi Embodied Intelligence Team, Yuechen Luo (University of Macau, Tsinghua University), Chong He (University of Macau, Tsinghua University), Fang Li (University of Macau, Tsinghua University), Shaoqing Xu (University of Macau, Tsinghua University), Jingkai Wang (University of Macau, Tsinghua University), Menglun Su (University of Macau, Tsinghua University), Jiaxin Liu (University of Macau, Tsinghua University), Shengyin Jiang (University of Macau, Tsinghua University), Zhiyi Lai (University of Macau, Tsinghua University), Long Chen (University of Macau, Tsinghua University), Longlong Wang (University of Macau, Tsinghua University), Liang Hu (University of Macau, Tsinghua University), Haochen Liu (University of Macau, Tsinghua University), Yuncheng Jiang (University of Macau, Tsinghua University), Hongwei Xie (University of Macau, Tsinghua University), Jieming Cui (University of Macau, Tsinghua University), Hanbing Li (University of Macau, Tsinghua University), Junjie Huang (University of Macau, Tsinghua University), Zhixiang Duan (University of Macau, Tsinghua University), Hexin Zhang (University of Macau, Tsinghua University), Weixiang Liang (University of Macau, Tsinghua University), Ying Gong (University of Macau, Tsinghua University), Yuhan Wang (University of Macau, Tsinghua University), Yong Pan (University of Macau, Tsinghua University), Pengna Li (University of Macau, Tsinghua University), Kangyi Wu (University of Macau, Tsinghua University), Ken Deng (University of Macau, Tsinghua University), Kun Ma (University of Macau, Tsinghua University), Fuxi Wen (University of Macau, Tsinghua University), Zhi-xin Yang (University of Macau, Tsinghua University), Hangjun Ye (University of Macau, Tsinghua University)
arXiv AI
Oct 9

RoboAware: Learning to Coordinate Embodied Skills from Counterfactual Outcomes

RoboAware learns to coordinate modular robot skills by training a state‑conditioned responsibility coordinator using counterfactual outcomes. It introduces State‑Locked Counterfactual Branching (SCB) to generate outcomes for all admissible skill families from the same state, and Execution‑Aware Learning (EAL) to distill these outcomes into family‑conditioned values via Monte Carlo tree search and Q‑learning. In single‑episode evaluations across 100 tasks, RoboAware achieves a 77.0% overall success rate, outperforming existing baselines on RoboSuite, LIBERO‑Pro, and RoboTwin bimanual tasks.

By Bohan Zhou, Xingbei Chen, Emily Huang, Weilin Ruan, Haojian Huang, Yehang Zhang, Zexi Li, Wenqian Li, Qize Yu, Zetian Song, Leyi Wu, Jinghao Li, Mingxuan Song, Xinrun Xu, Zongyang Qiu, Yangkai Wei, Tianyi Zhang, Kaiwen Zhou, Yinchuan Li, James Cheng