RoboAuto: Autonomous Robot Program Search through Multi-Level Physical Understanding
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
RoboAuto is a framework that enhances autonomous robot program search by explicitly incorporating physical understanding at the object, scene, and interaction levels. It uses a hierarchical knowledge base of executable skills and object-centric affordances, scene grounding to map knowledge to the current environment, and multi-stage planning with self-designed experiments to verify physical effects and resolve uncertainties. The approach achieves higher success rates than prior methods on multiple benchmark tasks and demonstrates transferability across simulators and embodiments.
arXiv:2607. 00272v1 Announce Type: cross Abstract: Traditional robot programming is challenging: it requires orchestrating multimodal perception, managing physical contact dynamics, and handling diverse configurations and execution failures.
RoboSPA is a large-scale robotic manipulation dataset and benchmark designed to evaluate Vision‑Language‑Action models on fine‑grained spatial reasoning and long‑horizon procedural planning. It contains 10 task categories, 56 base tasks, and 280 variants across five difficulty levels, with 527K trajectories collected from multiple embodiments and scenes. The benchmark introduces diagnostic metrics beyond binary success, revealing that current VLA models struggle with complex spatial relations, precise execution, and memory‑intensive planning.
HarnessPAI introduces a model‑ and embodiment‑agnostic harness framework for Physical AI that treats code as an executable, evolvable interface organizing action primitives. The framework operates on two timescales: within a rollout it executes an open‑loop program, and across rollouts it evolves a closed‑loop program using feedback to refine the program and distill reusable skills. Across diverse robotic platforms, HarnessPAI outperforms pure action models and code‑as‑policy baselines, achieving significant gains on tasks such as LIBERO‑PRO and RoboCasa, and enabling efficient expert‑data collection for further fine‑tuning.
arXiv:2503. 22122v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have demonstrated remarkable capabilities in robotic planning, particularly for long-horizon tasks that require a holistic understanding of the environment for task decomposition.
arXiv:2610.36013v1 Announce Type: new Abstract: General-purpose embodied intelligence requires robots to coordinate diverse skills over long horizons, track task progress, and recover from failures....