arXiv:2608. 20093v1 Announce Type: new Abstract: In this work, we present HandMvNet, one of the first real-time method designed to estimate 3D hand motion and shape from multi-view camera images.
By Muhammad Asad Ali, Nadia Robertini, Didier Stricker
Accurate monocular 4D hand reconstruction remains challenging. Per-frame discriminative regressors lack temporal context and often produce jittery predictions.
arXiv:2607. 11221v1 Announce Type: cross Abstract: Accurate monocular 4D hand reconstruction remains challenging.
By Mingxi Xu, Bowen Duan, Yi Gu, Zhengyang Shen, Renjing Xu, Yutao Yue
arXiv:2606. 25619v2 Announce Type: replace Abstract: In this paper, we present ScaleHP, a unified framework that explicitly represents per-instance metric scale to resolve the coupled errors in calibrated camera-space hand pose estimation.
By Ruitao Jing, Xingyu Chen, Hongyang Li, Qing Jiang, Yukai Shi, Lei Zhang
arXiv:2609.24482v1 Announce Type: new
Abstract: Monocular 3D human pose estimation (HPE) remains challenging due to depth ambiguity, occlu- sions, and the need for temporal consistency. While multi-v...
By Mena Kamel, Natalie Won, Amrut Sarangi, Sven Jager, Albert Pla Planas
VersaCamVLA introduces a camera‑configurable framework that separates camera‑set representation from action learning in Vision‑Language‑Action models. It learns a unified scene‑token interface that maps any number of posed RGB views into fixed‑size latent tokens using multi‑signal target‑view prediction and Wrist‑Augmented Pose Sampling. At deployment, a lightweight spatial encoder injects these tokens into a pretrained VLA, enabling robust manipulation without explicit 3D sensing or novel‑view rendering, and consistently outperforms prior methods across varying camera counts and unseen poses.
By Boyao Han, Chen Shi, Jingjing Qian, ZhuoTan Tian, Li Jiang
arXiv:2605.18553v2 Announce Type: replace-cross
Abstract: Recovering world space 4D motion of two interacting hands from egocentric video is a fundamental capability for supervising robot policy lear...
By Huajian Zeng, Chaohua Yao, Yuantai Zhang, Jiaqi Yang, Rolandos Alexandros Potamias, Xingxing Zuo
EgoHand is a monocular 3D hand reconstruction model that sets new state‑of‑the‑art results on egocentric video. It is trained on a curated 14‑million‑image corpus that blends synthetic data, in‑the‑wild video, and multi‑camera motion capture to balance diversity and supervision quality. The model uses SOMA‑Hand as its parametric representation, processes 2D hand crops with a transformer encoder, and incorporates camera cues and an auxiliary 2D branch to enhance geometric consistency and image alignment, achieving low inference latency and strong out‑of‑domain generalization on benchmarks such as HOT3D, ARCTIC, and H2O.
By Chao-Yeh Chen, Tiffany Chen, Lin Duan, Tianyi Hu, Yu-Hsiang Huang, Umar Iqbal, Jiefeng Li, Edy Lim, Yanchen Liu, Yihan Pang, Hang Qiu, Jun Saito, Shao Su, Qingsi Wang, Xiufeng Xie
The paper introduces JoHan, a generative framework that directly recovers 2D and 3D hand motion from video sequences without intermediate per‑frame pose predictions. By jointly learning temporal dynamics and 2D‑3D correspondence, JoHan generates aligned pose sequences that improve temporal consistency and enable accurate estimation of the hand’s global position and orientation relative to the camera. Experiments on challenging benchmarks show that JoHan achieves higher accuracy and faster performance, producing smoother hand‑motion dynamics while maintaining high per‑frame pose accuracy.
By Chen Xu, Yunqi Li, Binbin Huang, Brent Yi, Shenghua Gao, Yi Ma
arXiv:2610.29936v1 Announce Type: new
Abstract: Recovering metric world-space hand motion from egocentric video supports understanding human interactions and transferring them to embodied agents. Thr...
By Naru Suzuki, Satoshi Ikehata, Takehiko Ohkawa, Yoichi Sato, Shuhei Kurita
EventEgoHands++ is a new framework for reconstructing 3D hand meshes from egocentric event-based cameras. It introduces a Hand Detector that provides instance-level bounding boxes and masks for left and right hands, and an Adaptive Attention module that uses these detections to model spatial relationships and interactions. The authors extend the synthetic N-HOT3D dataset and create EEH‑R, a large real-world event-based egocentric hand dataset with about 1 million annotated frames, and show that their method outperforms existing baselines on both synthetic and real data.
By Ryosei Hara, Wataru Ikeda, Masashi Hatano, Mariko Isogawa
EgoHSI3R is a unified feed‑forward framework that reconstructs 4D hand‑scene interactions from egocentric monocular video. It jointly estimates camera motion, dense scene geometry, world‑space bilateral MANO hands, and per‑vertex hand contact by maintaining a recurrent scene representation and using hand‑centric prompts and MANO vertex queries. The method achieves the lowest world‑space hand joint error on ARCTIC while offering faster inference than existing pipelines.
By Mingzhi Pei, Zhangchen Ye, Ruoqu Chen, Liu Cao, Mengdi Xu