arXiv AI
Jul 20

Interaction-Aware Whole-Body Control for Compliant Object Transport

arXiv:2603. 03751v2 Announce Type: replace-cross Abstract: Cooperative object transport in unstructured environments remains challenging for assistive humanoids because strong, time-varying interaction forces can make tracking-centric whole-body control unreliable, especially in close-contact support tasks.

By Hao Zhang, Yves Tseng, Ding Zhao, H. Eric Tseng
arXiv AI
Oct 16

Whole-Body Dexterity

Whole-Body Dexterity (WBD) is a framework that enables robots to use their entire body and appendages as contact surfaces for grasping and manipulating objects. The approach generates a dataset of feasible whole-body grasps, trains reinforcement‑learning experts on a repositioning objective, and distills them into a single policy that relies on proprioception and object geometry. The distilled policy achieves zero‑shot transfer to a real Unitree G1 robot, successfully completing complex tasks such as stowing a box under one arm and moving it from a shelf to a table, with a 90% success rate in real‑world trials.

By Conor Mc Gartoll, An Dang, Pranay Thangeda, Arjun Gupta, Carolina Higuera, Nima Fazeli, Mustafa Mukadam, Manikantan Nambi
arXiv Computer Vision
Sep 21

ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation

ULTRA is a unified framework for autonomous humanoid whole-body locomotion and manipulation that overcomes limitations of prior methods by combining a physics-driven neural retargeting algorithm with a multimodal controller. The retargeting algorithm translates large-scale motion capture data into physically plausible humanoid motions, while the controller learns to handle both dense motion references and sparse task specifications using a range of sensory inputs, from accurate motion-capture states to noisy egocentric vision. In simulation and on a real Unitree G1 humanoid, ULTRA demonstrates improved generalization and robustness, enabling coordinated whole-body behavior from sparse intent without relying on test-time reference motions.

By Xialin He, Sirui Xu, Xinyao Li, Runpei Dong, Liuyu Bian, Yu-Xiong Wang, Liang-Yan Gui