arXiv Machine Learning
BiGym 2.0: Benchmarking Learned and Agent-Developed Policies for Humanoid Household Manipulation
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
3d ago
VioLA: Learning Generalist Humanoid Control Policies from Human Data
VioLA is a generalist humanoid control policy that predicts body and hand motion latents instead of joint commands, enabling a pretrained controller to execute these latents on a robot. By aligning human and robot motion in shared latent spaces, the policy can be trained on a large dataset of 140.6 million frames, 93.2% of which are human demonstrations. As a result, VioLA can follow locomotion and manipulation instructions on a real robot zero‑shot, achieving 100% locomotion success and 88.6% manipulation success without task‑specific fine‑tuning.
arXiv Machine Learning
4d ago
Workhorse: Learning Robust Whole-Body Humanoid Loco-Manipulation from Human Data
arXiv:2610.09117v1 Announce Type: cross Abstract: Humanoid robots still struggle to plan contact-rich whole-body manipulation from egocentric RGB and proprioception. Workhorse learns such manipulatio...
arXiv AI
Oct 2
HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Execution
HumanoidToolBench is an 18‑task benchmark designed to evaluate humanoid robots on tool selection, manipulation, and locomotion across three scenarios, execution levels, and tool‑set modes. It is accompanied by ToolBook, a dataset of 3.1k demonstrations collected in simulation and on a real Unitree G1 robot. Experiments with seven policies in simulation and three on the real robot show significant gaps between tool selection and task completion, especially on unseen tools and under unrelated instructions.
arXiv AI
Sep 18
Sim-and-Human Co-training for Data-Efficient and Scene-Generalizable Bimanual Manipulation
Sim-and-Human Co-training (SimHum) is a method that combines simulation and human demonstration data to train bimanual manipulation policies. It first extracts kinematic priors from simulation and visual priors from human observations, then fine‑tunes on a small real‑robot dataset. With only 80 real‑robot episodes per task, SimHum achieves 62.5% success on out‑of‑distribution scenes across four tabletop tasks, outperforming real‑only training by 53.7% and improving the best single‑source baseline by 35.0% in a matched‑time study.
arXiv AI
Aug 18
HAF: Adapting Generalist VLAs to Humanoid Whole-Body Loco-manipulation via Hierarchical Action Flow and Spectral Latent RL
arXiv:2608. 16837v1 Announce Type: cross Abstract: Humanoid robots hold great promise as general-purpose agents in human-centered environments, yet generalist vision-language-action (VLA) foundation models are not readily applicable to humanoid whole-body loco-manipulation.
Hugging Face Trending Papers
Aug 17
HAF: Adapting Generalist VLAs to Humanoid Whole-Body Loco-manipulation via Hierarchical Action Flow and Spectral Latent RL
Humanoid robots hold great promise as general-purpose agents in human-centered environments, yet generalist vision-language-action (VLA) foundation models are not readily applicable to humanoid whole-body loco-manipulation. The high dimensionality and interdependence of humanoid motions make it challenging for conventional single-stage VLA architectures to coordinate locomotion, waist posture, and dual-arm manipulation effectively.