arXiv Computation and Language

AdaRSI: On-Demand Recursive Self-Improvement for Embodied Agents

arXiv AI
Sep 2

EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents

EmbodiedSkills is a unified framework that treats each skill decision as an execution proposal, checking prerequisites and verifying outcomes during long‑horizon vision‑language‑action tasks. It connects high‑level skill selection, bounded low‑level VLA execution, and post‑action verification through a fixed executable‑skill interface, enabling easy replacement of low‑level policies and recording of structured trajectories for supervision and adaptation. Instantiated with Qwen3‑VL and OpenPI/pi0.5 on RoboTwin 2.0 and LIBERO, the framework achieves high success rates (86.20% and 97.40% respectively) and demonstrates effective memory‑dependent task performance.

By Wei Wang, Wenqiao Zhang, Yutong Lin, Yuqian Yuan, Tianwei Lin, Jinhao Mao, Zhenxuan Fan, Mingjian Gao, Yang Dai, Wentong Li, Zheqi Lv, Zheng Dong, Yingjie Niu, Jiaqi Zhu, Jun Xiao, Chao Li, Yueting Zhuang
arXiv AI
Oct 2

Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents

Reconstruct, Practice, Go Real (RPG) is a framework that enables autonomous improvement of robot execution systems without updating model weights. RPG identifies manipulation capabilities from offline data, creates simulation practice tasks, and uses feedback to diagnose failures, develop new symbolic skills, refine existing ones, and revise the system prompt. Across 22 manipulation tasks, RPG raises task success from 28.6% after the first practice round to 95.0% after 15 rounds, outperforming baselines and achieving perfect success on 30 physical trials after calibration.

By Yen-Jen Wang, Haozhe Jiang, Shuying Deng, Haoru Xue, Weirui Ye, Rocky Duan, Nika Haghtalab, S. Shankar Sastry, Pieter Abbeel, Haozhi Qi
arXiv Machine Learning
Sep 21

From Pretraining to Proficiency: Real-World Subtask RL for Long-Horizon Manipulation with Minimal Human Intervention

The paper introduces PARTS, a real‑world subtask reinforcement learning framework that fine‑tunes a pretrained robot policy by focusing on critical bottleneck subtasks while keeping the base policy frozen. It uses agent‑generated selectors and success verifiers to provide local rewards, enabling learning even when full‑task successes are rare. Experiments on bimanual YAM and single‑arm Franka robots show that PARTS raises complete‑task success from 32% to 61% and from 50% to 95%, respectively, with only tens of minutes of real‑world RL rollouts and minimal human intervention.

By Sichang Su, Benjamin Yang, Zhiyun Deng, Boyuan Liang, Yip Fun Yeung, Zelin Wang, Lingfeng Sun
arXiv AI
Oct 1

RoboCoach: World Models as Active Coaches for Compositional Robot Skills

RoboCoach introduces a world-model-guided coaching framework that uses imagined failures to direct demonstration requests and expert updates for robot manipulation tasks. The system, called RIDI, runs reusable skill experts within a shared action-conditioned world model and records the first failing subtask to decide which demonstrations to acquire and which adapters to refine. Experiments on simulation suites and real robots show that with only 150 additional subtask demonstrations, success rates increase dramatically, and the coached experts transfer effectively to unseen task compositions.

By Jiajun Liu, Yifan Chen, Yichao Liu, Jiayi Zhang, Ruoqu Chen, Shaoxuan Xie, Guocai Yao, Mengdi Xu, Sen Cui, Changshui Zhang
arXiv Computer Vision
Oct 9

Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvement

The paper proposes a new paradigm called Code-Only-as-Policy (COAP), treating the embodied world as a Turing machine where the robot and environment state are the tape and the policy is the code. COAP replaces traditional vision-language agents by using code to measure, track, and decide based on camera images and proprioception, enabling explicit state storage, fast execution, and extensibility across tasks. On RoboDojo’s 42 bimanual tasks, the COAP library achieved a 70.24% success rate without a model at test time.

By Kairui Hu, Siyuan Hu, Fangzhou Hong, Zhaoxi Chen, Ziwei Liu