arXiv Machine Learning

AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimation

AdaptManip is a fully autonomous framework that enables humanoid robots to navigate, lift, and deliver objects without human demonstrations. It combines a recurrent state estimator for real‑time object tracking, a whole‑body locomotion policy with residual manipulation control, and a LiDAR‑based global position estimator. Trained entirely in simulation with reinforcement learning, the system achieves zero‑shot deployment on real hardware, outperforming imitation‑learning baselines in adaptability and success rate.

arXiv Computer Vision
Sep 21

ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation

ULTRA is a unified framework for autonomous humanoid whole-body locomotion and manipulation that overcomes limitations of prior methods by combining a physics-driven neural retargeting algorithm with a multimodal controller. The retargeting algorithm translates large-scale motion capture data into physically plausible humanoid motions, while the controller learns to handle both dense motion references and sparse task specifications using a range of sensory inputs, from accurate motion-capture states to noisy egocentric vision. In simulation and on a real Unitree G1 humanoid, ULTRA demonstrates improved generalization and robustness, enabling coordinated whole-body behavior from sparse intent without relying on test-time reference motions.

By Xialin He, Sirui Xu, Xinyao Li, Runpei Dong, Liuyu Bian, Yu-Xiong Wang, Liang-Yan Gui
arXiv Computer Vision
Aug 25

TONAV: Task-Oriented Navigation and Action-Velocity Chunk Learning for Articulated Object Quadrupedal Mobile Manipulation

arXiv:2608.22296v1 Announce Type: cross Abstract: Quadruped mobile manipulation requires two tightly coupled capabilities: reaching manipulation-ready configurations and maintaining stable contact th...

By Haoran Lin, Mingyu Yang, Pengfei Qi, Kehan Chen, Qiang Diao, Liangji Zeng, Wenrui Chen, Yaonan Wang, Kailun Yang
arXiv AI
Aug 19

ORPA: Online Residual Policy Adaptation for Robot Manipulation Control with Human Feedback

The paper introduces ORPA, a framework that adds a lightweight, feedback-conditioned module to a pretrained robotic manipulation policy, enabling real‑time residual adjustments in joint space without retraining the base policy. ORPA allows immediate correction of execution errors and distribution shifts, improving success rates and recovery on precision‑sensitive tasks compared to baseline policies and rule‑based inverse kinematics. The method is evaluated on the ALOHA platform, showing its effectiveness in real‑time deployment scenarios.

By Muhammad A. Muttaqien, Tomohiro Motoda, Ryo Hanai, Yukiyasu Domae
arXiv Machine Learning
Jul 31

REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning

arXiv:2603. 13707v3 Announce Type: replace-cross Abstract: Humanoid loco-manipulation requires coordinated task-space motion planning with stable loco-manipulation command tracking under complex robot-environment dynamics and long-horizon tasks.

By Zhaoyuan Gu, Yipu Chen, Zimeng Chai, Alfred Cueva, Thong Nguyen, Yifan Wu, Huishu Xue, Minji Kim, Isaac Legene, Fukang Liu, KyoungMok Kim, Ayan Barula, Yongxin Chen, Ye Zhao
arXiv AI
Sep 18

Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control

The paper introduces Sampling-Guided Policy Search (SGPS), a method that combines sampling-based model‑predictive control with first‑order policy gradients to accelerate visual policy learning for locomotion and manipulation tasks. SGPS starts with behavior cloning from sampled actions and then alternates between sampling‑based refinement and short‑horizon policy updates under varied initial states and dynamics. The approach is demonstrated on simulated Unitree Go2 and G1 robots, learning tasks such as obstacle traversal and bimanual carrying, and the distilled policies transfer zero‑shot to a real Go2 robot using onboard depth perception.

By Yilang Liu, Haoxiang You, Qian Wang, Daniel Rakita, Ian Abraham
arXiv Machine Learning
Jun 5

LadderMan: Learning Humanoid Perceptive Ladder Climbing

arXiv:2606. 05873v1 Announce Type: cross Abstract: Humanoid robots hold great promise for operating in human-centered environments, yet ladder climbing remains one of the most challenging tasks due to sparse footholds and handholds, complex whole-body coordination, and sensitivity to perception and control errors.

By Siheng Zhao, Yuanhang Zhang, Ziqi Lu, Pieter Abbeel, Rocky Duan, Koushil Sreenath, Yue Wang, C. Karen Liu, Guanya Shi
arXiv Machine Learning
Aug 4

DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration

arXiv:2608. 01452v1 Announce Type: cross Abstract: Dynamic manipulation is a critical capability for robots operating in complex and dynamic environments, where robots must interact with objects that are moving or require rapid adjustments.

By Haoran Liao, Pengyue Wang, Shuoyu Chen, Kehan Cheng, Xuhang Chen, Yuhao Lin, Mu Lin, Zhizhao Liang, Xiaoyi Fan, Chengyi Xing, Dan Niu, Yi-Lin Wei, Wei-Shi Zheng
arXiv Machine Learning
Sep 23

MAVP: Map-Aware Visuomotor Policies for Mobile Manipulation

MAVP (Map-Aware Visuomotor Policies) is a framework that enhances mobile manipulation by predicting explicit base-pose targets and tracking them with localisation feedback. It reconstructs a static map from teleoperated demonstrations, expressing base trajectories in a shared map frame to provide consistent spatial supervision. During execution, the policy uses RGB observations, joint states, and the robot’s current map-frame base pose to jointly predict target base poses, arm actions, and gripper actions, while a low‑level controller corrects deviations using feedforward motion and pose error feedback. Pose‑noise augmentation during training further improves robustness, and MAVP outperforms unanchored velocity control across six real‑world tasks and three policy families.

By Jinhe Tang, Ruixiao Dai, Weiming Zhi