arXiv AI

DemoStream: Batched Task-and-Motion-Plan Optimization for Automated Learning from Demonstration

DemoStream is a Task and Motion Planning (TAMP) system that uses GPU‑accelerated batched sampling to generate high‑quality demonstrations for robotic manipulation. By optimizing demonstration quality and exploring many solutions in parallel, it improves behavior cloning success rates and enables real‑world demo collection at an average of 66 demos per hour. The approach evaluates different action spaces, cost functions, and batch sizes in simulation to understand their impact on downstream policy performance.

arXiv Machine Learning
Oct 9

A Balanced Data Diet: Addressing the Exploration Bottleneck in Mega-Scale RL for Robot Control

The paper introduces Success Guided Sampling (SGS), an adaptive sampler that focuses reinforcement learning on task configurations near the policy’s current frontier, thereby reducing wasted experience in massively parallel simulation. SGS enables large‑scale RL to solve complex quadruped locomotion and contact‑rich assembly tasks that previous methods could not, using up to one million parallel environments. The authors also distill the learned policies into RGB‑based models that transfer zero‑shot to real‑world assembly tasks.

By Octi Zhang, Mateo Guaman Castro, Patrick Yin, Ignacio Dagnino, Abhishek Gupta, Rosario Scalise, Byron Boots
arXiv Computer Vision
Oct 9

Dex-One2Many: Learning Dexterous Manipulation from a Single Human Demonstration

Dex-One2Many introduces a real-to-sim-to-real framework that learns a generalizable dexterous manipulation policy from a single human video. By abstracting the video into sequential scene graphs, the method guides reinforcement learning with dense rewards and diverse reset states, enabling efficient exploration while preserving broad generalizability. Trained entirely in simulation, Dex-One2Many achieves zero‑shot transfer to a real multi‑fingered hand and outperforms baselines by 6.5% on seen configurations and 71% on unseen scenarios across five tool‑use and manipulation tasks.

By Jusuk Lee, Sungha Kim, Yeonsoo Park, Jonguk Cheon, Yoonkyo Jung, Yongjun You, H. Jin Kim, Jia-Bin Huang, Furong Huang, Youngseok Jang, Seungjae Lee
arXiv AI
Sep 18

Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control

The paper introduces Sampling-Guided Policy Search (SGPS), a method that combines sampling-based model‑predictive control with first‑order policy gradients to accelerate visual policy learning for locomotion and manipulation tasks. SGPS starts with behavior cloning from sampled actions and then alternates between sampling‑based refinement and short‑horizon policy updates under varied initial states and dynamics. The approach is demonstrated on simulated Unitree Go2 and G1 robots, learning tasks such as obstacle traversal and bimanual carrying, and the distilled policies transfer zero‑shot to a real Go2 robot using onboard depth perception.

By Yilang Liu, Haoxiang You, Qian Wang, Daniel Rakita, Ian Abraham
arXiv Machine Learning
Aug 4

DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration

arXiv:2608. 01452v1 Announce Type: cross Abstract: Dynamic manipulation is a critical capability for robots operating in complex and dynamic environments, where robots must interact with objects that are moving or require rapid adjustments.

By Haoran Liao, Pengyue Wang, Shuoyu Chen, Kehan Cheng, Xuhang Chen, Yuhao Lin, Mu Lin, Zhizhao Liang, Xiaoyi Fan, Chengyi Xing, Dan Niu, Yi-Lin Wei, Wei-Shi Zheng
arXiv AI
Aug 13

TMRL: Diffusion Timestep-Modulated Pretraining Enables Exploration for Efficient Policy Finetuning

arXiv:2605. 12236v2 Announce Type: replace-cross Abstract: Fine-tuning pre-trained robot policies with reinforcement learning (RL) often inherits the bottlenecks introduced by pre-training with behavioral cloning (BC), which produces narrow action distributions that lack the coverage necessary for downstream exploration.

By Matthew M. Hong, Jesse Zhang, Anusha Nagabandi, Abhishek Gupta