arXiv Computer Vision

DCGrasp: Distance-aware Controllable Grasp Generation

arXiv Computer Vision
Oct 8

VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation

The paper introduces VolCo, a volumetric contact representation that extends surface points into 3D grids to model hand-object interactions more accurately. Using a 3D variational autoencoder for local contact details and a prior-guided diffusion model for global hand geometry, the VolCoDiff framework achieves tighter grasps with reduced penetration on benchmark datasets. The authors provide code for reproducibility.

By Zhuo Chen, Yihua Cheng, Ale\v{s} Leonardis, Hyung Jin Chang
arXiv AI
Oct 19

MANGO-Grasp: Mahalanobis Fields over Geometry-Oriented 3D Gaussians for Cross-Embodiment Dexterous Grasping

MANGO‑Grasp introduces an anisotropic interaction framework for cross‑embodiment dexterous grasping. It represents objects as geometry‑oriented 3D Gaussian primitives to preserve local surface geometry, encodes hands with pretrained descriptors that capture morphology and kinematics, and models hand‑object interaction using anisotropic Mahalanobis fields. The method achieves state‑of‑the‑art performance on CMAP and MultiGripperGrasp benchmarks, outperforms baselines by up to 8.24 percentage points in simulation, and demonstrates strong zero‑shot transfer to the unseen SharpaWave hand with up to 16.57 percentage point improvement, achieving 86% success in real‑world experiments.

By Heng Zhang, Kevin Yuchen Ma, Mike Zheng Shou, Weisi Lin, Yan Wu
arXiv Computer Vision
6d ago

PiHand: Latent Hand-Object Interaction Priors for Physics-Based Policy Learning

PiHand is a physics‑based framework that learns latent hand‑object interaction priors for dexterous manipulation. It first trains expert policies to track motion capture demonstrations, then distills these into a goal‑conditioned VAE that captures coupled hand‑object motion. Using bounded residual exploration in this latent space, PiHand produces general tabletop manipulation policies that generalize to unseen objects and trajectories, outperforming baselines across multiple tasks.

By Niklas Berndt, Xianghui Xie, Enes Duran, Yixiao Wang, Gerard Pons-Moll
arXiv AI
Jun 19

Human Universal Grasping

arXiv:2606. 17054v1 Announce Type: cross Abstract: Humans can grasp objects effortlessly, whereas multi-fingered robots are far from this level of generality.

By Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu, Billy Yan, Irmak Guzey, David Fouhey, Dandan Shan, Lerrel Pinto
Hugging Face Trending Papers
Oct 22

PiHand: Latent Hand-Object Interaction Priors for Physics-Based Policy Learning

PiHand is a physics‑based policy learning framework that synthesizes realistic hand‑object interactions for dexterous manipulation. It first trains expert policies to track motion capture data, then distills these into a goal‑conditioned VAE that captures coupled hand‑object motion. Using bounded residual exploration in this latent space, PiHand produces general tabletop manipulation policies that generalize to unseen objects and trajectories, outperforming baselines across multiple tasks.

arXiv Computer Vision
Oct 9

OmniDex: Scaling Dexterous Hand Grasping to Diverse Cluttered Scenes

OmniDex presents a large-scale benchmark for dexterous hand grasping, featuring over 2.6 million cluttered scenes and 0.4 B scene-specific grasp ground truths generated via a scalable seed-and-filter strategy. The paper introduces the OmniDex model, which uses Soft Winner-Takes-All learning, human-inspired physical constraints, and physics-driven ranking to address multimodality and precision errors in generative grasp models. Experimental results demonstrate that OmniDex achieves state‑of‑the‑art performance and strong generalization across diverse scenes, views, and unseen objects.

By Naiyu Fang, Zhongjin Luo, Yuxin Mo, Siyuan Huang, Jianbo Liu, Yufei Liu, Zheyuan Zhou, Chenkai Jin, Xiaogang Wang, Hongsheng Li