arXiv AI
1d ago

RoboAuto: Autonomous Robot Program Search through Multi-Level Physical Understanding

RoboAuto is a framework that enhances autonomous robot program search by explicitly incorporating physical understanding at the object, scene, and interaction levels. It uses a hierarchical knowledge base of executable skills and object-centric affordances, scene grounding to map knowledge to the current environment, and multi-stage planning with self-designed experiments to verify physical effects and resolve uncertainties. The approach achieves higher success rates than prior methods on multiple benchmark tasks and demonstrates transferability across simulators and embodiments.

By Buzhao Liu, Jianing Ye, Xiu Yuan, Yangtong Feng, Chengsong Huang, Tyler Dinh, Yevgeniy Vorobeychik, Ning Zhang, Chongjie Zhang
arXiv AI
Jul 2

ASPIRE: Agentic /Skills Discovery for Robotics

arXiv:2607. 00272v1 Announce Type: cross Abstract: Traditional robot programming is challenging: it requires orchestrating multimodal perception, managing physical contact dynamics, and handling diverse configurations and execution failures.

By Runyu Lu, Yubo Wu, Ethan Kou, Letian Fu, Wenli Xiao, Ajay Mandlekar, Yinzhen Xu, Guanya Shi, Ken Goldberg, Ang Chen, Mosharaf Chowdhury, Yuke Zhu, Linxi "Jim" Fan, Guanzhi Wang
arXiv AI
Sep 7

RoboSPA: Can VLA Models Go Beyond Simple Scenes and Short-Horizon Tasks?

RoboSPA is a large-scale robotic manipulation dataset and benchmark designed to evaluate Vision‑Language‑Action models on fine‑grained spatial reasoning and long‑horizon procedural planning. It contains 10 task categories, 56 base tasks, and 280 variants across five difficulty levels, with 527K trajectories collected from multiple embodiments and scenes. The benchmark introduces diagnostic metrics beyond binary success, revealing that current VLA models struggle with complex spatial relations, precise execution, and memory‑intensive planning.

By Zhenxuan Fan, Bo Zhang, Yutong Lin, Yuqian Yuan, Juekai Lin, Liang Liang, Zhuoyi Huang, Wenqiao Zhang, Juncheng Li, Siliang Tang, Jun Xiao, Yueting Zhuang
Hugging Face Trending Papers
Sep 24

HarnessPAI: An Evolving Harness for Physical AI

HarnessPAI introduces a model‑ and embodiment‑agnostic harness framework for Physical AI that treats code as an executable, evolvable interface organizing action primitives. The framework operates on two timescales: within a rollout it executes an open‑loop program, and across rollouts it evolves a closed‑loop program using feedback to refine the program and distill reusable skills. Across diverse robotic platforms, HarnessPAI outperforms pure action models and code‑as‑policy baselines, achieving significant gains on tasks such as LIBERO‑PRO and RoboCasa, and enabling efficient expert‑data collection for further fine‑tuning.

arXiv AI
Aug 11

REMAC: Self-Reflective and Self-Evolving Multi-Agent Collaboration for Long-Horizon Robot Manipulation

arXiv:2503. 22122v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have demonstrated remarkable capabilities in robotic planning, particularly for long-horizon tasks that require a holistic understanding of the environment for task decomposition.

By Puzhen Yuan, Angyuan Ma, Yunchao Yao, Huaxiu Yao, Masayoshi Tomizuka, Mingyu Ding
arXiv Computation and Language
1d ago

OmniBrain-0: A Unified Agentic Model for Embodied Intelligence

arXiv:2610.36013v1 Announce Type: new Abstract: General-purpose embodied intelligence requires robots to coordinate diverse skills over long horizons, track task progress, and recover from failures....

By Xiaomi Embodied Intelligence Team, Yuechen Luo (University of Macau, Tsinghua University), Chong He (University of Macau, Tsinghua University), Fang Li (University of Macau, Tsinghua University), Shaoqing Xu (University of Macau, Tsinghua University), Jingkai Wang (University of Macau, Tsinghua University), Menglun Su (University of Macau, Tsinghua University), Jiaxin Liu (University of Macau, Tsinghua University), Shengyin Jiang (University of Macau, Tsinghua University), Zhiyi Lai (University of Macau, Tsinghua University), Long Chen (University of Macau, Tsinghua University), Longlong Wang (University of Macau, Tsinghua University), Liang Hu (University of Macau, Tsinghua University), Haochen Liu (University of Macau, Tsinghua University), Yuncheng Jiang (University of Macau, Tsinghua University), Hongwei Xie (University of Macau, Tsinghua University), Jieming Cui (University of Macau, Tsinghua University), Hanbing Li (University of Macau, Tsinghua University), Junjie Huang (University of Macau, Tsinghua University), Zhixiang Duan (University of Macau, Tsinghua University), Hexin Zhang (University of Macau, Tsinghua University), Weixiang Liang (University of Macau, Tsinghua University), Ying Gong (University of Macau, Tsinghua University), Yuhan Wang (University of Macau, Tsinghua University), Yong Pan (University of Macau, Tsinghua University), Pengna Li (University of Macau, Tsinghua University), Kangyi Wu (University of Macau, Tsinghua University), Ken Deng (University of Macau, Tsinghua University), Kun Ma (University of Macau, Tsinghua University), Fuxi Wen (University of Macau, Tsinghua University), Zhi-xin Yang (University of Macau, Tsinghua University), Hangjun Ye (University of Macau, Tsinghua University)