← Back to all news
arXiv Machine Learning By Yuxuan Kuang, Jiashun Wang, Yixuan Sun, Yufei Ye, Sungjae Park, Umar Iqbal, Katerina Fragkiadaki, Shubham Tulsiani

Learning Adaptable Dexterous Skills via Hybrid Dexterous Mimicking

Read the original on arXiv Machine Learning →

AdaDex is a goal‑conditioned reinforcement learning framework that transforms a short hand‑object trajectory—captured via mocap or in‑the‑wild RGB(D) video—into an adaptable dexterous skill. It trains a shared policy on two parallel environment populations: motion‑tracking environments that embed human priors and generalization environments that enforce robustness to noisy states and goals. The resulting policies achieve diverse, functional dexterous behaviors such as grasping, re‑posing, in‑hand reorientation, and dynamic throw‑and‑catch, outperforming baselines in generalization and demonstrating transfer from simulation to the real world.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
Jun 10

Dexterous Point Policy: Learning Point-based Dexterous Hand Policies from Human Demonstrations

arXiv:2606. 10614v1 Announce Type: cross Abstract: Robotic foundation models pre-trained on human demonstration videos have shown promise, but a significant embodiment gap remains when the resulting policies are deployed on real robots.

By Beomjun Kim, Seong Hyeon Park, Seunghoon Sim, Seungjun Moon, Sanghyeok Lee, Jinwoo Shin
llmsagentsroboticsfine-tuningbenchmarks
More like this →
arXiv Computer Vision
Oct 9

Dex-One2Many: Learning Dexterous Manipulation from a Single Human Demonstration

Dex-One2Many introduces a real-to-sim-to-real framework that learns a generalizable dexterous manipulation policy from a single human video. By abstracting the video into sequential scene graphs, the method guides reinforcement learning with dense rewards and diverse reset states, enabling efficient exploration while preserving broad generalizability. Trained entirely in simulation, Dex-One2Many achieves zero‑shot transfer to a real multi‑fingered hand and outperforms baselines by 6.5% on seen configurations and 71% on unseen scenarios across five tool‑use and manipulation tasks.

By Jusuk Lee, Sungha Kim, Yeonsoo Park, Jonguk Cheon, Yoonkyo Jung, Yongjun You, H. Jin Kim, Jia-Bin Huang, Furong Huang, Youngseok Jang, Seungjae Lee
reinforcement-learningrobotics
More like this →
arXiv AI
Aug 20

ADEPT: Accelerating Dexterity via Pre-Training and Post-Training using Reinforcement Learning

ADEPT is a reinforcement‑learning framework that first pre‑trains a dexterous policy on a generic object reposing task and then post‑trains downstream policies using this pretrained behavior as a prior. The approach avoids relearning basic skills for each new task, and employs a stable post‑training recipe—behavior‑cloning distillation, critic warm‑up, and conservative on‑policy updates—to preserve the pretrained capabilities. ADEPT’s joint‑space Geometric Fabric mediates between the policy and the robot, enabling zero‑shot sim‑to‑real transfer on a 23‑DoF Kuka‑Allegro and a 29‑DoF Flexiv‑Sharpa, where the robots solve long‑horizon tasks from challenging initial states at human‑level speed.

By Jayjun Lee, Jessica Yin, Asif Rana, Nicholas Blauch, Sam Mady, Mohak Bhardwaj, Nima Fazeli, Nathan Ratliff, Karl Van Wyk, Ankur Handa
reinforcement-learningroboticsfine-tuningefficiency
More like this →