arXiv Machine Learning

GIFT: Geometry-Induced Functional Transfer for Category-level Object Manipulation

arXiv:2503. 15371v2 Announce Type: replace-cross Abstract: Robotic manipulation of unfamiliar objects in new environments is challenging due to limited generalisation capabilities.

arXiv AI
Oct 2

FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoning

FuncBridge is a two‑stage framework that addresses functional generalization in robotics by decoupling functional reasoning from action execution. It learns to predict generalizable 2D keypoint trajectories from action‑free data and then grounds these trajectories into robot actions with limited demonstrations. Across a benchmark of ten tools and three functions—hitting, sweeping, and hooking—FuncBridge outperforms state‑of‑the‑art methods on unseen tools in both simulation and real‑world tests.

By Chuhao Zhou, Liquan Wang, Shuxin Cao, Xiangyu Chen, Yuxuan Hu, Boyu Ma, Animesh Garg, Jianfei Yang
arXiv AI
Sep 25

KeyGen: Unsupervised Keypoint based Object-Centric Representations for Category-Level Policy Generalization

KeyGen is a framework that learns canonical 3D keypoints from point clouds to create structured, object‑centric representations for policy learning in robotic manipulation. By conditioning a visuomotor diffusion policy on these keypoints and object geometry, it predicts full manipulation trajectories that maintain geometric correspondence across different object instances. Experiments on a photorealistic simulation benchmark with three tasks show that KeyGen outperforms prior methods on both seen and unseen objects, scales with more demonstrations, remains robust to rescaling, and performs well in real‑world manipulation.

By Shuxin Cao, Liquan Wang, Masoud Moghani, Benjamin Joffe, Animesh Garg
arXiv Computer Vision
Oct 8

UniCross: Unified Cross-Skill Dexterous Manipulation Synthesis

UniCross proposes a unified framework that models the four canonical dexterous manipulation skills—grasping, relocation, in-hand rotation, and in-hand translation—within a single formulation sharing state, action spaces, and objective structure. This approach enables distillation of a single cross-skill policy that performs well across all skills, generalizes to unseen objects, remains robust to disturbances, and can chain skills into long-horizon manipulation without policy switching. The framework also transfers effectively across different hand morphologies, suggesting that these skills can be viewed as instantiations of a shared task formulation.

By Hui Zhang, Julian Ferchow, Jie Song, Mirko Meboldt
arXiv AI
Jun 9

GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation

arXiv:2606. 08530v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models achieve strong benchmark performance but still struggle in real-world deployment with unseen objects, background shifts, and different robot embodiments.

By Yuan Zhang, Shiqi Zhang, Yedong Shen, Shuai Dong, Jiajun Deng, Xin Zhang, Yuxuan Gao, Jiajia Wu, Xin Nie, Zhiyuan Cheng, Jianmin Ji, Yanyong Zhang, Xingyi Zhang, Jia Pan
arXiv Machine Learning
Jun 10

Dexterous Point Policy: Learning Point-based Dexterous Hand Policies from Human Demonstrations

arXiv:2606. 10614v1 Announce Type: cross Abstract: Robotic foundation models pre-trained on human demonstration videos have shown promise, but a significant embodiment gap remains when the resulting policies are deployed on real robots.

By Beomjun Kim, Seong Hyeon Park, Seunghoon Sim, Seungjun Moon, Sanghyeok Lee, Jinwoo Shin
arXiv Machine Learning
Jun 19

Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentation

arXiv:2606. 20118v1 Announce Type: cross Abstract: Vision-language-action (VLA) policies have shown strong potential for general-purpose manipulation, yet they often fail on novel, out-of-distribution objects whose appearance or geometry deviates from the training distribution.

By Jonghoon Lee, Seong Hyeon Park, Byungwoo Jeon, Minha Lee, Jinwoo Shin
Hugging Face Trending Papers
Jul 6

Simple-to-Complex Structured Demonstrations for Vision-Language-Action Learning

Vision-Language-Action (VLA) models have demonstrated strong capabilities in robotic manipulation by integrating visual perception, language understanding, and robot action generation. Existing research has primarily focused on improving model architectures, training strategies, and dataset scale, while little attention has been paid to how demonstrations are collected and organized.