arXiv AI

TTT-Parkour: Rapid Test-Time Training for Perceptive Robot Parkour

arXiv AI
Jun 17

OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction

arXiv:2509. 26633v3 Announce Type: replace-cross Abstract: A dominant paradigm for teaching humanoid robots complex skills is to retarget human motions as kinematic references to train reinforcement learning (RL) policies.

By Lujie Yang, Xiaoyu Huang, Zhen Wu, Angjoo Kanazawa, Pieter Abbeel, Carmelo Sferrazza, C. Karen Liu, Rocky Duan, Guanya Shi
arXiv Machine Learning
Jul 31

REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning

arXiv:2603. 13707v3 Announce Type: replace-cross Abstract: Humanoid loco-manipulation requires coordinated task-space motion planning with stable loco-manipulation command tracking under complex robot-environment dynamics and long-horizon tasks.

By Zhaoyuan Gu, Yipu Chen, Zimeng Chai, Alfred Cueva, Thong Nguyen, Yifan Wu, Huishu Xue, Minji Kim, Isaac Legene, Fukang Liu, KyoungMok Kim, Ayan Barula, Yongxin Chen, Ye Zhao
arXiv Machine Learning
Oct 22

Watch Your Step: Anticipated Perception for Humanoid Locomotion

The paper proposes a lightweight foothold prediction model (FPM) that anticipates future foot placements using only proprioception and velocity commands, allowing the robot to sample elevation maps only around predicted footholds. This preprocessing reduces redundant sensory input, enabling the locomotion policy to learn faster—reaching a given terrain difficulty in about one‑third the training iterations compared to using the full elevation map. The resulting policy outperforms both full‑map and attention‑based encoders on sparse foothold scenarios, and it zero‑shot transfers to a Unitree G1 humanoid across diverse indoor and outdoor obstacles.

By Matthias Heyrman, Chenhao Li, Ioannis Dadiotis, Marco Hutter
arXiv AI
Jul 23

PGTT: Phase-Guided Terrain Traversal for Perceptive Legged Locomotion

arXiv:2510. 18348v2 Announce Type: replace-cross Abstract: State-of-the-art perceptive Reinforcement Learning controllers for legged robots typically either (i) impose oscillator-or IK-based gait priors that constrain the action space, bias policy optimization, and limit adaptability across robot morphologies, or (ii) operate "blind," making them unable to anticipate hind-leg terrain and brittle to observation noise.

By Alexandros Ntagkas, Chairi Kiourt, Konstantinos Chatzilygeroudis
arXiv Machine Learning
Oct 12

HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videos

HumanX is a unified framework that transforms human videos into generalizable, real‑world interaction skills for humanoid robots without task‑specific design. It combines XGen, a data‑generation pipeline that creates physically plausible robot interaction data from monocular video, with XMimic, a learning framework that extracts interaction priors from only seconds of demonstration. Across five domains—basketball, football, badminton, cargo pickup, and reactive fighting—HumanX learns nine distinct skills and transfers them zero‑shot to a physical Unitree G1 humanoid, achieving complex maneuvers and sustained passing sequences from a single video.

By Yinhuai Wang, Qihan Zhao, Yuen Fui Lau, Runyi Yu, Hok Wai Tsui, Qifeng Chen, Jingbo Wang, Jiangmiao Pang, Ping Tan
arXiv AI
Sep 17

Language-Guided Terrain-Adaptive Neural MPC for Autonomous Traversal of Articulated Tracked Robots

The paper introduces ASTRIL-MPC, a language‑guided neural model predictive control framework that enables articulated tracked robots to navigate complex, contact‑rich urban environments such as stairwells and cluttered interiors. By combining a learned kinematics model that predicts short‑horizon state changes, an optimization‑based planner with multi‑objective costs, and a large language model that safely updates control weights, the system achieves up to 71% better traversal quality than non‑adaptive NMPC and 67% better than a PPO baseline, while eliminating collision impacts during descent. Real‑robot trials over four indoor obstacles confirm the method’s transferability to physical contact‑rich traversal.

By Zhenfeng Gan, Yanbo Chen, Lirong Che, Yongyi Ma, Rongkai Zhu, Xueqian Wang