arXiv Computer Vision

StableGrasp: Reconstructing Physically Stable Human Hand Grasps from Single Images

arXiv AI
Oct 19

MANGO-Grasp: Mahalanobis Fields over Geometry-Oriented 3D Gaussians for Cross-Embodiment Dexterous Grasping

MANGO‑Grasp introduces an anisotropic interaction framework for cross‑embodiment dexterous grasping. It represents objects as geometry‑oriented 3D Gaussian primitives to preserve local surface geometry, encodes hands with pretrained descriptors that capture morphology and kinematics, and models hand‑object interaction using anisotropic Mahalanobis fields. The method achieves state‑of‑the‑art performance on CMAP and MultiGripperGrasp benchmarks, outperforms baselines by up to 8.24 percentage points in simulation, and demonstrates strong zero‑shot transfer to the unseen SharpaWave hand with up to 16.57 percentage point improvement, achieving 86% success in real‑world experiments.

By Heng Zhang, Kevin Yuchen Ma, Mike Zheng Shou, Weisi Lin, Yan Wu
arXiv AI
Sep 4

Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis

AdaRoboVLG is a Vision‑Language‑Grasp framework that separates a generalizable base grasp policy from task‑specific understanding. The base policy generates and evaluates physically feasible grasp candidates using kinematic mapping and force‑closure stability, while foundation‑model modules supply composable spatial, cognitive, and temporal priors that adapt grasp synthesis to different robotic hands and environments without retraining. Experiments show strong cross‑hand generalization, effective handling of diverse grasping challenges, and functional grasping in cluttered, dynamic settings.

By Sixu Yan, Shikang Wang, Binhua Huang, Xuanlai Tang, Guohua Fan, Fan Huang, Haoxuan Li, Yongkang Li, Yuhan Li, Bencheng Liao, Zeyu Zhang, Wenyu Liu, Hangxin Liu, Xinggang Wang
arXiv Computer Vision
Oct 9

OmniDex: Scaling Dexterous Hand Grasping to Diverse Cluttered Scenes

OmniDex presents a large-scale benchmark for dexterous hand grasping, featuring over 2.6 million cluttered scenes and 0.4 B scene-specific grasp ground truths generated via a scalable seed-and-filter strategy. The paper introduces the OmniDex model, which uses Soft Winner-Takes-All learning, human-inspired physical constraints, and physics-driven ranking to address multimodality and precision errors in generative grasp models. Experimental results demonstrate that OmniDex achieves state‑of‑the‑art performance and strong generalization across diverse scenes, views, and unseen objects.

By Naiyu Fang, Zhongjin Luo, Yuxin Mo, Siyuan Huang, Jianbo Liu, Yufei Liu, Zheyuan Zhou, Chenkai Jin, Xiaogang Wang, Hongsheng Li
arXiv AI
Jun 19

Human Universal Grasping

arXiv:2606. 17054v1 Announce Type: cross Abstract: Humans can grasp objects effortlessly, whereas multi-fingered robots are far from this level of generality.

By Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu, Billy Yan, Irmak Guzey, David Fouhey, Dandan Shan, Lerrel Pinto
arXiv Computer Vision
Aug 28

Grasp in Gaussians: Fast Monocular Reconstruction of Dynamic Hand-Object Interactions

Grasp in Gaussians (GraG) is a fast, robust method for reconstructing dynamic 3D hand‑object interactions from a single monocular video. It leverages pretrained hand and object priors and represents the scene with a compact Sum‑of‑Gaussians (SoG) model, enabling efficient tracking while preserving geometric fidelity. Experiments show GraG achieves temporally coherent reconstructions on long sequences 4.4×–38.9× faster than prior work.

By Ayce Idil Aytekin, Xu Chen, Zhengyang Shen, Thabo Beeler, Helge Rhodin, Rishabh Dabral, Christian Theobalt
arXiv Computer Vision
Oct 23

PiHand: Latent Hand-Object Interaction Priors for Physics-Based Policy Learning

PiHand is a physics‑based framework that learns latent hand‑object interaction priors for dexterous manipulation. It first trains expert policies to track motion capture demonstrations, then distills these into a goal‑conditioned VAE that captures coupled hand‑object motion. Using bounded residual exploration in this latent space, PiHand produces general tabletop manipulation policies that generalize to unseen objects and trajectories, outperforming baselines across multiple tasks.

By Niklas Berndt, Xianghui Xie, Enes Duran, Yixiao Wang, Gerard Pons-Moll