Robotics and embodied AI

Manipulation, locomotion, sim-to-real transfer and autonomous driving: learning systems that have to survive physics.

4,380 stories · RSS feed

arXiv AI
Jun 4

CoRe-MoE: Contrastive Reweighted Mixture of Experts for Multi-Terrain Humanoid Locomotion with Gait Adaptation

arXiv:2606. 04718v1 Announce Type: cross Abstract: Humans primarily rely on walking and running to traverse complex terrains, without resorting to unnecessarily complex motion patterns.

By Kailun Huang (Hong Kong University of Science and Technology), Zikang Xie (Hong Kong University of Science and Technology), Yanzhe Xie (Hong Kong University of Science and Technology), Panpan Liao (Guangdong University of Technology), Fanghai Zhang (Hong Kong University of Science and Technology), Yanheng Mai (Hong Kong University of Science and Technology), Wenhao Xu (South China Agricultural University), Yunheng Wang (Hong Kong University of Science and Technology), Renjing Xu (Hong Kong University of Science and Technology), Haohui Huang (Guangdong University of Technology)
arXiv AI
Jun 4

ContactExplorer: Contact Coverage-Guided Exploration for General-Purpose Dexterous Manipulation

arXiv:2603. 10971v2 Announce Type: replace-cross Abstract: Reinforcement learning has achieved remarkable success in domains such as Atari games, navigation, and locomotion, where exploration can often be guided by novelty over states or dynamics.

By Zixuan Liu, Ruoyi Qiao, Chenrui Tie, Xuanwei Liu, Yunfan Lou, Chongkai Gao, Zhixuan Xu, Lin Shao
Hugging Face Trending Papers
Jun 3

NextMotionQA: Benchmarking and Judging Human Motion Understanding with Vision-Language Models

Reliable evaluation of human motion understanding is fundamental to advancing embodied AI, robotics, and animation. However, existing benchmarks suffer from coarse semantic granularity, undifferentiated difficulty, limited annotation quality, and pervasive answer ambiguity, leaving them unable to diagnose where current models fail.

Hugging Face Trending Papers
Jun 3

VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training

Universal Manipulation Interface (UMI) enables scalable real-world robot data collection without hardware-specific teleoperation, yet leveraging UMI data to train large-scale Vision-Language-Action (VLA) models remains fundamentally challenging. We identify two critical mismatches: wrist-mounted fisheye views, with severe radial distortion and local gripper-centric perspectives, are out-of-distribution for pretrained VLMs; and human-collected trajectories frequently violate kinematic limits, incur collisions, or exceed controller bandwidth, teaching VLA policies physically infeasible actions.

arXiv AI
Jun 3

Grasp-Then-Plan with Failure Attribution: A Closed Two-Stage Framework for Precise and Generalizable Robotic Manipulation

arXiv:2606. 03385v1 Announce Type: cross Abstract: In robotic manipulation, the tight coupling between grasping and motion planning often obscures the true source of failure, leading to inefficient trial-and-error.

By Jiahao Xu, Peiyuan Wang, Hanzhuo Zhang, Zihao Yu, Tianyu Fu, Hao Chen, Xuanhao Xiang, Jianbo Yu, Chenchen Fu, Wanyuan Wang