arXiv Machine Learning By Cristiana de Farias, Luis Figueredo, Riddhiman Laha, Maxime Adjigble, Brahim Tamadazte, Rustam Stolkin, Sami Haddadin, Naresh Marturi

GIFT: Geometry-Induced Functional Transfer for Category-level Object Manipulation

Read the original on arXiv Machine Learning →

arXiv:2503. 15371v2 Announce Type: replace-cross Abstract: Robotic manipulation of unfamiliar objects in new environments is challenging due to limited generalisation capabilities.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 2

FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoning

FuncBridge is a two‑stage framework that addresses functional generalization in robotics by decoupling functional reasoning from action execution. It learns to predict generalizable 2D keypoint trajectories from action‑free data and then grounds these trajectories into robot actions with limited demonstrations. Across a benchmark of ten tools and three functions—hitting, sweeping, and hooking—FuncBridge outperforms state‑of‑the‑art methods on unseen tools in both simulation and real‑world tests.

By Chuhao Zhou, Liquan Wang, Shuxin Cao, Xiangyu Chen, Yuxuan Hu, Boyu Ma, Animesh Garg, Jianfei Yang
arXiv AI
Sep 25

KeyGen: Unsupervised Keypoint based Object-Centric Representations for Category-Level Policy Generalization

KeyGen is a framework that learns canonical 3D keypoints from point clouds to create structured, object‑centric representations for policy learning in robotic manipulation. By conditioning a visuomotor diffusion policy on these keypoints and object geometry, it predicts full manipulation trajectories that maintain geometric correspondence across different object instances. Experiments on a photorealistic simulation benchmark with three tasks show that KeyGen outperforms prior methods on both seen and unseen objects, scales with more demonstrations, remains robust to rescaling, and performs well in real‑world manipulation.

By Shuxin Cao, Liquan Wang, Masoud Moghani, Benjamin Joffe, Animesh Garg
arXiv Computer Vision
Oct 8

UniCross: Unified Cross-Skill Dexterous Manipulation Synthesis

UniCross proposes a unified framework that models the four canonical dexterous manipulation skills—grasping, relocation, in-hand rotation, and in-hand translation—within a single formulation sharing state, action spaces, and objective structure. This approach enables distillation of a single cross-skill policy that performs well across all skills, generalizes to unseen objects, remains robust to disturbances, and can chain skills into long-horizon manipulation without policy switching. The framework also transfers effectively across different hand morphologies, suggesting that these skills can be viewed as instantiations of a shared task formulation.

By Hui Zhang, Julian Ferchow, Jie Song, Mirko Meboldt
arXiv AI
Jun 9

GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation

arXiv:2606. 08530v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models achieve strong benchmark performance but still struggle in real-world deployment with unseen objects, background shifts, and different robot embodiments.

By Yuan Zhang, Shiqi Zhang, Yedong Shen, Shuai Dong, Jiajun Deng, Xin Zhang, Yuxuan Gao, Jiajia Wu, Xin Nie, Zhiyuan Cheng, Jianmin Ji, Yanyong Zhang, Xingyi Zhang, Jia Pan