arXiv:2606.29924v2 Announce Type: replace
Abstract: Generating 3D hand-object interactions is essential for applications in robotics, AR/VR, and synthetic data generation, where flexible controllabil...
By Hiroyasu Akada, Jes\'us P\'erez, Emre Aksan, Vasileios Choutas, Cristian Romero, Alberto Garcia-Garcia, Vladislav Golyanik, Christian Theobalt, Thabo Beeler
arXiv:2608.28386v1 Announce Type: new
Abstract: Existing monocular full-body 3D human-object interaction (HOI) methods do not combine explicit finger-level grasp optimization with category-agnostic o...
By Semin Kim, Haechan Shin, Jongyoo Kim
MANGO‑Grasp introduces an anisotropic interaction framework for cross‑embodiment dexterous grasping. It represents objects as geometry‑oriented 3D Gaussian primitives to preserve local surface geometry, encodes hands with pretrained descriptors that capture morphology and kinematics, and models hand‑object interaction using anisotropic Mahalanobis fields. The method achieves state‑of‑the‑art performance on CMAP and MultiGripperGrasp benchmarks, outperforms baselines by up to 8.24 percentage points in simulation, and demonstrates strong zero‑shot transfer to the unseen SharpaWave hand with up to 16.57 percentage point improvement, achieving 86% success in real‑world experiments.
By Heng Zhang, Kevin Yuchen Ma, Mike Zheng Shou, Weisi Lin, Yan Wu
AdaRoboVLG is a Vision‑Language‑Grasp framework that separates a generalizable base grasp policy from task‑specific understanding. The base policy generates and evaluates physically feasible grasp candidates using kinematic mapping and force‑closure stability, while foundation‑model modules supply composable spatial, cognitive, and temporal priors that adapt grasp synthesis to different robotic hands and environments without retraining. Experiments show strong cross‑hand generalization, effective handling of diverse grasping challenges, and functional grasping in cluttered, dynamic settings.
By Sixu Yan, Shikang Wang, Binhua Huang, Xuanlai Tang, Guohua Fan, Fan Huang, Haoxuan Li, Yongkang Li, Yuhan Li, Bencheng Liao, Zeyu Zhang, Wenyu Liu, Hangxin Liu, Xinggang Wang
OmniDex presents a large-scale benchmark for dexterous hand grasping, featuring over 2.6 million cluttered scenes and 0.4 B scene-specific grasp ground truths generated via a scalable seed-and-filter strategy. The paper introduces the OmniDex model, which uses Soft Winner-Takes-All learning, human-inspired physical constraints, and physics-driven ranking to address multimodality and precision errors in generative grasp models. Experimental results demonstrate that OmniDex achieves state‑of‑the‑art performance and strong generalization across diverse scenes, views, and unseen objects.
By Naiyu Fang, Zhongjin Luo, Yuxin Mo, Siyuan Huang, Jianbo Liu, Yufei Liu, Zheyuan Zhou, Chenkai Jin, Xiaogang Wang, Hongsheng Li
arXiv:2609.36454v1 Announce Type: new
Abstract: We study hand-object interaction (HOI) reconstruction from monocular RGB videos, where partial observations can produce visually plausible yet mechanic...
By Wenliang Guo, Zhanbo Huang, Yu Kong
arXiv:2505. 05517v3 Announce Type: replace-cross Abstract: Functional grasping is essential for enabling dexterous multi-finger robot hands to manipulate objects effectively.
By Hongyi Chen, Yunchao Yao, Yufei Ye, Zhixuan Xu, Homanga Bharadhwaj, Jiashun Wang, Arthur Jakobsson, Ruihan Zhao, Shubham Tulsiani, Zackory Erickson, Jeffrey Ichnowski
arXiv:2606. 17054v1 Announce Type: cross Abstract: Humans can grasp objects effortlessly, whereas multi-fingered robots are far from this level of generality.
By Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu, Billy Yan, Irmak Guzey, David Fouhey, Dandan Shan, Lerrel Pinto
arXiv:2609.16319v1 Announce Type: cross
Abstract: Dexterous grasping is usually conducted for specific tasks, leading to heterogeneous constraints such as specific approach directions, desired contac...
By Hui Zhang, Mirko Meboldt, Jie Song
Grasp in Gaussians (GraG) is a fast, robust method for reconstructing dynamic 3D hand‑object interactions from a single monocular video. It leverages pretrained hand and object priors and represents the scene with a compact Sum‑of‑Gaussians (SoG) model, enabling efficient tracking while preserving geometric fidelity. Experiments show GraG achieves temporally coherent reconstructions on long sequences 4.4×–38.9× faster than prior work.
By Ayce Idil Aytekin, Xu Chen, Zhengyang Shen, Thabo Beeler, Helge Rhodin, Rishabh Dabral, Christian Theobalt
PiHand is a physics‑based framework that learns latent hand‑object interaction priors for dexterous manipulation. It first trains expert policies to track motion capture demonstrations, then distills these into a goal‑conditioned VAE that captures coupled hand‑object motion. Using bounded residual exploration in this latent space, PiHand produces general tabletop manipulation policies that generalize to unseen objects and trajectories, outperforming baselines across multiple tasks.
By Niklas Berndt, Xianghui Xie, Enes Duran, Yixiao Wang, Gerard Pons-Moll
arXiv:2610.10283v1 Announce Type: cross
Abstract: Humans can grasp everyday objects with almost perfect success rates using fingertip tactile feedback, yet much of the robotic grasping literature emp...
By Ken Nakahara, Aleksei Buvailik, Prokhor Kotov, Roberto Calandra