arXiv AI

MANGO-Grasp: Mahalanobis Fields over Geometry-Oriented 3D Gaussians for Cross-Embodiment Dexterous Grasping

MANGO‑Grasp introduces an anisotropic interaction framework for cross‑embodiment dexterous grasping. It represents objects as geometry‑oriented 3D Gaussian primitives to preserve local surface geometry, encodes hands with pretrained descriptors that capture morphology and kinematics, and models hand‑object interaction using anisotropic Mahalanobis fields. The method achieves state‑of‑the‑art performance on CMAP and MultiGripperGrasp benchmarks, outperforms baselines by up to 8.24 percentage points in simulation, and demonstrates strong zero‑shot transfer to the unseen SharpaWave hand with up to 16.57 percentage point improvement, achieving 86% success in real‑world experiments.

arXiv AI
Jun 19

Human Universal Grasping

arXiv:2606. 17054v1 Announce Type: cross Abstract: Humans can grasp objects effortlessly, whereas multi-fingered robots are far from this level of generality.

By Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu, Billy Yan, Irmak Guzey, David Fouhey, Dandan Shan, Lerrel Pinto
arXiv Computer Vision
Sep 28

Enabling a Unified Cross-Domain Representation for Two-Finger Gripper Manipulation via Interaction-Centric Modeling

The paper introduces an interaction‑centric framework that unifies representations for two‑finger gripper manipulation across different robot embodiments. By using a parameterized universal gripper abstraction and a canonical gripper‑frame representation, the system infers sub‑tasks from language and RGB‑D inputs, grounds interaction triplets, and employs hybrid features and a Flow‑Matching Transformer to generate smooth 7‑DoF action sequences. Experiments in both simulation and real‑world settings show that this approach achieves competitive benchmark performance while enabling extreme cross‑embodiment and cross‑viewpoint zero‑shot sim‑to‑real transfer to heterogeneous robot platforms.

By Guanlin Li, Shifeng Bao, Yihan Zhao, Haitao Shen, Haoyang Li, Chen Zhao, Tong Yang, Jie Tang, Jing Zhang
arXiv Computer Vision
Oct 8

VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation

The paper introduces VolCo, a volumetric contact representation that extends surface points into 3D grids to model hand-object interactions more accurately. Using a 3D variational autoencoder for local contact details and a prior-guided diffusion model for global hand geometry, the VolCoDiff framework achieves tighter grasps with reduced penetration on benchmark datasets. The authors provide code for reproducibility.

By Zhuo Chen, Yihua Cheng, Ale\v{s} Leonardis, Hyung Jin Chang