arXiv Computer Vision

GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image

arXiv AI
Oct 19

MANGO-Grasp: Mahalanobis Fields over Geometry-Oriented 3D Gaussians for Cross-Embodiment Dexterous Grasping

MANGO‑Grasp introduces an anisotropic interaction framework for cross‑embodiment dexterous grasping. It represents objects as geometry‑oriented 3D Gaussian primitives to preserve local surface geometry, encodes hands with pretrained descriptors that capture morphology and kinematics, and models hand‑object interaction using anisotropic Mahalanobis fields. The method achieves state‑of‑the‑art performance on CMAP and MultiGripperGrasp benchmarks, outperforms baselines by up to 8.24 percentage points in simulation, and demonstrates strong zero‑shot transfer to the unseen SharpaWave hand with up to 16.57 percentage point improvement, achieving 86% success in real‑world experiments.

By Heng Zhang, Kevin Yuchen Ma, Mike Zheng Shou, Weisi Lin, Yan Wu
arXiv AI
Jun 19

Human Universal Grasping

arXiv:2606. 17054v1 Announce Type: cross Abstract: Humans can grasp objects effortlessly, whereas multi-fingered robots are far from this level of generality.

By Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu, Billy Yan, Irmak Guzey, David Fouhey, Dandan Shan, Lerrel Pinto
arXiv AI
Jun 11

TextHOI-3D: Text-to-3D Hand-Object Interaction via Discrete Multi-View Generation and Joint Mesh Optimization

arXiv:2606. 11805v1 Announce Type: cross Abstract: Text-conditioned 3D generation has progressed rapidly for images and isolated objects, but producing a hand-object mesh remains challenging: the output must preserve language semantics, cross-view consistency, object geometry, articulated hand shape, and physically plausible contact.

By Zixiong Hao, Zhencun Jiang
arXiv Computer Vision
Oct 8

VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation

The paper introduces VolCo, a volumetric contact representation that extends surface points into 3D grids to model hand-object interactions more accurately. Using a 3D variational autoencoder for local contact details and a prior-guided diffusion model for global hand geometry, the VolCoDiff framework achieves tighter grasps with reduced penetration on benchmark datasets. The authors provide code for reproducibility.

By Zhuo Chen, Yihua Cheng, Ale\v{s} Leonardis, Hyung Jin Chang
Hugging Face Trending Papers
Jun 10

TextHOI-3D: Text-to-3D Hand-Object Interaction via Discrete Multi-View Generation and Joint Mesh Optimization

Text-conditioned 3D generation has progressed rapidly for images and isolated objects, but producing a hand-object mesh remains challenging: the output must preserve language semantics, cross-view consistency, object geometry, articulated hand shape, and physically plausible contact. We present TextHOI-3D, a staged framework that uses generated multi-view observations as an explicit interface between text-conditioned visual generation and geometry-aware hand-object recovery.

arXiv Machine Learning
Oct 23

EgoHand: Monocular 3D Hand Reconstruction from Egocentric Video

EgoHand is a monocular 3D hand reconstruction model that sets new state‑of‑the‑art results on egocentric video. It is trained on a curated 14‑million‑image corpus that blends synthetic data, in‑the‑wild video, and multi‑camera motion capture to balance diversity and supervision quality. The model uses SOMA‑Hand as its parametric representation, processes 2D hand crops with a transformer encoder, and incorporates camera cues and an auxiliary 2D branch to enhance geometric consistency and image alignment, achieving low inference latency and strong out‑of‑domain generalization on benchmarks such as HOT3D, ARCTIC, and H2O.

By Chao-Yeh Chen, Tiffany Chen, Lin Duan, Tianyi Hu, Yu-Hsiang Huang, Umar Iqbal, Jiefeng Li, Edy Lim, Yanchen Liu, Yihan Pang, Hang Qiu, Jun Saito, Shao Su, Qingsi Wang, Xiufeng Xie