Human Demonstrations as Post-Training Data for Any Robot Body: Retargeting the Object, Not the Hand
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
VioLA is a generalist humanoid control policy that predicts body and hand motion latents instead of joint commands, enabling a pretrained controller to execute these latents on a robot. By aligning human and robot motion in shared latent spaces, the policy can be trained on a large dataset of 140.6 million frames, 93.2% of which are human demonstrations. As a result, VioLA can follow locomotion and manipulation instructions on a real robot zero‑shot, achieving 100% locomotion success and 88.6% manipulation success without task‑specific fine‑tuning.
arXiv:2609.08123v1 Announce Type: cross Abstract: A robot that can be taught a new task from a handful of demonstrations has to work out for itself what it still cannot do, and then ask for exactly t...
arXiv:2609.37359v1 Announce Type: cross Abstract: Coding agents can now write, run, and debug programs with little human help. Robot tasks, however, are usually specified by a sentence that leaves ou...
arXiv:2609.26420v1 Announce Type: cross Abstract: Text-to-motion models generate plausible human motion but do not model a robot's dynamics; whole-body tracking controllers execute robot references r...
arXiv:2606. 03134v1 Announce Type: cross Abstract: Imitation-learning policies for robot manipulation inherit the quality of the success labels attached to their training episodes, and those labels are usually produced by the robot's own success check.
arXiv:2609.24660v2 Announce Type: cross Abstract: Human demonstrations offer a scalable way to collect manipulation data, but their contacts may be unstable or infeasible when transferred to a robot...