arXiv Machine Learning By Yanming Zhou, Yuchen Liu, Ahmed H. Qureshi

Shape-Aware Neural Time Fields for Rigid-Body Motion and Manipulation Planning

Read the original on arXiv Machine Learning →

Shape-Aware Neural Time Fields is a physics‑informed neural motion planning framework that learns a reusable travel‑time (cost‑to‑go) representation for rigid‑body motion, explicitly accounting for distinct geometric restrictions on translation and rotation. The learned field captures local motion difficulty and is combined with a sampling‑based planner that balances progress toward the goal with the cost of reaching nearby poses. Experiments on 2D and 3D planning tasks and non‑prehensile manipulation show substantial improvements in planning success and inference efficiency over neural baselines, while remaining competitive with classical planners at lower planning times, and closed‑loop pushing tests demonstrate fast replanning for reactive execution.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computer Vision
Sep 25

Representation World Model: Learning States, Transition and Executable Plans in Representation

The Representation World Model (RWM) learns states, transitions, and executable plans directly within a representation space, bypassing traditional explicit dynamics models and action-space search. It uses inverse-dynamics supervision along latent paths to shape the representation geometry, enabling direct planning by constructing a latent path between current and goal states and recovering actions via inverse dynamics. Experiments on continuous-control benchmarks and robotic manipulation tasks demonstrate RWM’s effectiveness and potential for complex embodied control.

By Yijun Yuan, Weicheng Zheng, Weibang Wang, Minghui Qin, Chang Sun, Junhao Huang, Kenan Li, Anmin Liu, Yicheng Yao, Hang Zhao
arXiv Computer Vision
Sep 21

ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation

ULTRA is a unified framework for autonomous humanoid whole-body locomotion and manipulation that overcomes limitations of prior methods by combining a physics-driven neural retargeting algorithm with a multimodal controller. The retargeting algorithm translates large-scale motion capture data into physically plausible humanoid motions, while the controller learns to handle both dense motion references and sparse task specifications using a range of sensory inputs, from accurate motion-capture states to noisy egocentric vision. In simulation and on a real Unitree G1 humanoid, ULTRA demonstrates improved generalization and robustness, enabling coordinated whole-body behavior from sparse intent without relying on test-time reference motions.

By Xialin He, Sirui Xu, Xinyao Li, Runpei Dong, Liuyu Bian, Yu-Xiong Wang, Liang-Yan Gui