arXiv Machine Learning

Watch Your Step: Anticipated Perception for Humanoid Locomotion

The paper proposes a lightweight foothold prediction model (FPM) that anticipates future foot placements using only proprioception and velocity commands, allowing the robot to sample elevation maps only around predicted footholds. This preprocessing reduces redundant sensory input, enabling the locomotion policy to learn faster—reaching a given terrain difficulty in about one‑third the training iterations compared to using the full elevation map. The resulting policy outperforms both full‑map and attention‑based encoders on sparse foothold scenarios, and it zero‑shot transfers to a Unitree G1 humanoid across diverse indoor and outdoor obstacles.

arXiv AI
Jul 23

PGTT: Phase-Guided Terrain Traversal for Perceptive Legged Locomotion

arXiv:2510. 18348v2 Announce Type: replace-cross Abstract: State-of-the-art perceptive Reinforcement Learning controllers for legged robots typically either (i) impose oscillator-or IK-based gait priors that constrain the action space, bias policy optimization, and limit adaptability across robot morphologies, or (ii) operate "blind," making them unable to anticipate hind-leg terrain and brittle to observation noise.

By Alexandros Ntagkas, Chairi Kiourt, Konstantinos Chatzilygeroudis
arXiv Machine Learning
Jun 16

LoComposition: Terrain-Adaptive Energy-Efficient Quadruped Locomotion without Gait Priors

arXiv:2606. 15896v1 Announce Type: cross Abstract: Learning-based quadrupedal locomotion typically relies on complex reward formulations that entangle task specification, operational limits, gait preference, and terrain adaptation within a single optimization objective.

By Loukas Kordos, Leonard T. Franz, Simon Rappenecker, Oliver Hausdoerfer, Angela P. Schoellig, Pavel Kolev, Georg Martius
arXiv Machine Learning
Sep 21

FootQuery: Future-Touchdown-Guided Retrieval from Depth History for Perceptive Humanoid Locomotion

FootQuery is a perceptive locomotion framework that retrieves depth information from a robot’s own history by querying each foot’s predicted next touchdown. The policy uses proprioceptive predictions of touchdown locations and uncertainties to sample relevant historical depth frames, fuses these per‑foot features with global visual memory, and generates control actions. In simulation and on a real Unitree G1 robot, FootQuery enables continuous traversal of complex outdoor stairs, indoor routes, platforms, and gaps, outperforming component ablations.

By Tao Dong, Jia Yu, Yuxuan Fan, Linna Zhao, Jiaqi Gong, Andong Yang, Chao Gao, Guyue Zhou
arXiv AI
Jun 4

CoRe-MoE: Contrastive Reweighted Mixture of Experts for Multi-Terrain Humanoid Locomotion with Gait Adaptation

arXiv:2606. 04718v1 Announce Type: cross Abstract: Humans primarily rely on walking and running to traverse complex terrains, without resorting to unnecessarily complex motion patterns.

By Kailun Huang (Hong Kong University of Science and Technology), Zikang Xie (Hong Kong University of Science and Technology), Yanzhe Xie (Hong Kong University of Science and Technology), Panpan Liao (Guangdong University of Technology), Fanghai Zhang (Hong Kong University of Science and Technology), Yanheng Mai (Hong Kong University of Science and Technology), Wenhao Xu (South China Agricultural University), Yunheng Wang (Hong Kong University of Science and Technology), Renjing Xu (Hong Kong University of Science and Technology), Haohui Huang (Guangdong University of Technology)
arXiv AI
Sep 18

Accelerating Visual Policy Learning with Sampling-Based Model Predictive Control

The paper introduces Sampling-Guided Policy Search (SGPS), a method that combines sampling-based model‑predictive control with first‑order policy gradients to accelerate visual policy learning for locomotion and manipulation tasks. SGPS starts with behavior cloning from sampled actions and then alternates between sampling‑based refinement and short‑horizon policy updates under varied initial states and dynamics. The approach is demonstrated on simulated Unitree Go2 and G1 robots, learning tasks such as obstacle traversal and bimanual carrying, and the distilled policies transfer zero‑shot to a real Go2 robot using onboard depth perception.

By Yilang Liu, Haoxiang You, Qian Wang, Daniel Rakita, Ian Abraham
arXiv Machine Learning
Jul 31

REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning

arXiv:2603. 13707v3 Announce Type: replace-cross Abstract: Humanoid loco-manipulation requires coordinated task-space motion planning with stable loco-manipulation command tracking under complex robot-environment dynamics and long-horizon tasks.

By Zhaoyuan Gu, Yipu Chen, Zimeng Chai, Alfred Cueva, Thong Nguyen, Yifan Wu, Huishu Xue, Minji Kim, Isaac Legene, Fukang Liu, KyoungMok Kim, Ayan Barula, Yongxin Chen, Ye Zhao