arXiv AI
RoboTryOn: Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
22h ago
Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
The paper introduces RoboTryOn, a method that transforms human egocentric videos into synthetic demonstrations for robots by virtually swapping the human with a target robot while preserving task, objects, and background. It uses autoregressive keyframe translation guided by human hand skeletons and an inverse dynamics model to generate action labels for policy learning. Experiments on various humanoid robots show that policies trained on these synthetic videos achieve up to 60% success on new tasks, matching teleoperated demonstration performance at roughly one‑third the cost.
arXiv AI
Jun 2
From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
arXiv:2606. 00054v1 Announce Type: cross Abstract: Recent progress in generalizable embodied control has been driven by large-scale pretraining of Vision-Language-Action (VLA) models.
arXiv Machine Learning
Jun 16
DemoDiffusion: One-Shot Human Imitation using pre-trained Diffusion Policy
arXiv:2506. 20668v3 Announce Type: replace-cross Abstract: We propose DemoDiffusion, a simple method for enabling robots to perform manipulation tasks by imitating a single human demonstration, without requiring task-specific training or paired human-robot data.
arXiv Machine Learning
Oct 9
Being-M0.7: A Latent World-Action Model for Humanoid Robots
Being‑M0.7 is a latent world‑action model that learns from a large mixed‑modality human dataset (over 10,000 hours of video‑only, motion‑only, and paired video‑motion data) to predict future latent visual states and motion. The model is pre‑trained on human data, adapted to robot viewpoints during mid‑training, and then combined with an action expert via gated cross‑attention during post‑training to produce executable whole‑body commands. In experiments, Being‑M0.7 outperforms baselines on the SIMPLE benchmark and matches the best baseline on real‑world Unitree G1 loco‑manipulation tasks.
arXiv AI
Sep 30
EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation
arXiv:2609.37181v1 Announce Type: cross Abstract: Human demonstrations capture diverse scenes and rich whole-body skills without requiring robot teleoperation. Prior work on egocentric transfer has e...
arXiv AI
22h ago
RoboCurate: Harnessing Diversity with Action-Verified Synthetic Data for Robot Learning
arXiv:2602.18742v2 Announce Type: replace-cross Abstract: Synthetic data generated by video generative models has shown promise for robot learning as a scalable pipeline, but it often suffers from no...