Dex-One2Many introduces a real-to-sim-to-real framework that learns a generalizable dexterous manipulation policy from a single human video. By abstracting the video into sequential scene graphs, the method guides reinforcement learning with dense rewards and diverse reset states, enabling efficient exploration while preserving broad generalizability. Trained entirely in simulation, Dex-One2Many achieves zero‑shot transfer to a real multi‑fingered hand and outperforms baselines by 6.5% on seen configurations and 71% on unseen scenarios across five tool‑use and manipulation tasks.
By Jusuk Lee, Sungha Kim, Yeonsoo Park, Jonguk Cheon, Yoonkyo Jung, Yongjun You, H. Jin Kim, Jia-Bin Huang, Furong Huang, Youngseok Jang, Seungjae Lee
AdaDex is a goal‑conditioned reinforcement learning framework that transforms a short hand‑object trajectory—captured via mocap or in‑the‑wild RGB(D) video—into an adaptable dexterous skill. It trains a shared policy on two parallel environment populations: motion‑tracking environments that embed human priors and generalization environments that enforce robustness to noisy states and goals. The resulting policies achieve diverse, functional dexterous behaviors such as grasping, re‑posing, in‑hand reorientation, and dynamic throw‑and‑catch, outperforming baselines in generalization and demonstrating transfer from simulation to the real world.
By Yuxuan Kuang, Jiashun Wang, Yixuan Sun, Yufei Ye, Sungjae Park, Umar Iqbal, Katerina Fragkiadaki, Shubham Tulsiani
arXiv:2610.14691v2 Announce Type: cross
Abstract: Recent advances in 3D hand-object interaction (HOI) perception have opened new opportunities for learning dexterous robotic skills from human videos....
By Zihan Gao, Yuhong Zhang, Mengzhe Wang, Kaisheng Liu, Shengpeng Li, Siyao Xiao, Runqing Cheng, Xiao Lin, Zhifang Liu, Haoqian Wang
arXiv:2606. 10614v1 Announce Type: cross Abstract: Robotic foundation models pre-trained on human demonstration videos have shown promise, but a significant embodiment gap remains when the resulting policies are deployed on real robots.
By Beomjun Kim, Seong Hyeon Park, Seunghoon Sim, Seungjun Moon, Sanghyeok Lee, Jinwoo Shin
DexPIE is a post‑training framework that improves dexterous manipulation policies using real‑world experience. It introduces a dexterous‑hand‑adapted intervention system and multi‑stage DAgger‑style data collection to enhance exploration, aligns training and inference to reduce distribution shift, and conditions the policy on a continuous optimality indicator for fine‑grained data quality use. In three real‑world tasks, DexPIE boosts success rates by 37.3% over a demonstration‑based baseline, outperforming all other methods and showing stronger robustness.
By Ruizhe Liao, Wenrui Chen, Liangji Zeng, Haoran Lin, Fan Yang, Kailun Yang, Yaonan Wang
arXiv:2610.29997v1 Announce Type: cross
Abstract: Despite recent progress in dexterous reference tracking, existing models focus primarily on single-hand manipulation and a limited range of interacti...
By Mingze Sun, Ziang Cao, Yuan Fei, Qiankuan Tao, Zihan Wang, Tianqi Liu, Junhao Chen, Haiwen Diao, Fangzhou Hong, Zhaoxi Chen, Ziwei Liu