Skill-Space Shooting for Autonomous Robot Policy Improvement
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
arXiv:2609.38178v1 Announce Type: cross Abstract: Robots deployed in the physical world must be able to improve beyond their initial training as they encounter new situations and failures. For this i...
The paper introduces SUN (Semantically UNified) Programs, typed executables that translate grounded relations into optimal control objectives, satisfaction predicates, and learning rewards. Using the Kuafu harness, a foundation model orchestrates scene preparation, verification, residual reinforcement learning, and data generation, repairing candidate programs and calibrating reward weights. Across nine multi‑stage manipulation tasks, Kuafu achieves an 82.03% success rate, outperforms learned baselines, generates demonstrations 10.57× faster than human teleoperation, and transfers zero‑shot to physical Franka and Kinova robots.
The paper introduces Adaptive Residual Correction (ARC), a lightweight post‑training module that adds a reinforcement‑learning–driven residual correction to a frozen imitation policy. ARC uses sparse human corrections to decide when the residual should activate, where in the residual action space to explore, and what the final residual action should be, thereby treating local failures as a localized learning problem rather than a global one. In experiments on three precision‑manipulation tasks, ARC raises average task success from 33.3 % to 75.0 % and confines the residual corrections to 2–3 dimensional subspaces that capture over 96 % of the correction magnitude. "whyItMatters":"The results demonstrate that sparse human guidance can effectively localize and constrain autonomous post‑training corrections, enabling significant performance gains without requiring full policy updates or dense human supervision."
Teach-and-Grow Learning (TGL) is an agent-centered architecture that transforms a few successful demonstrations into reusable Skill Blocks, enabling a robot to compose, execute, and revise behaviors in new scenes without task-specific policy retraining. The system maintains a Skill Library and structured Experience Memory to capture successes, failures, and repairs, allowing persistent reuse and agent-directed adaptation. Evaluation on the LIBERO benchmark shows state-of-the-art performance, and the authors propose a scaling-law hypothesis suggesting that accumulated reusable experience reduces future-task error and teaching demand following a power-law trend.
Vision-language-action and world-action models have demonstrated impressive capabilities in robotics, yet generalization to unseen tasks remains challenging. More recently, general-purpose multimodal...
arXiv:2607. 23784v1 Announce Type: cross Abstract: While vision-language-action models have demonstrated impressive zero-shot manipulation capabilities, they remain fundamentally black box policies that are difficult to interpret, adapt, or correct when they inevitably fail.