arXiv Computer Vision

ScaleHP: Scale-Mediated Optimization of Coupled Errors for Metric-Space Hand Pose Estimation

arXiv:2606. 25619v2 Announce Type: replace Abstract: In this paper, we present ScaleHP, a unified framework that explicitly represents per-instance metric scale to resolve the coupled errors in calibrated camera-space hand pose estimation.

arXiv Computer Vision
Sep 14

KAD-Net: Kinematics-Aware Decoupled Learning for Robust 3D Hand Pose Estimation from a Single Depth Image

KAD-Net introduces a Kinematics-Aware Decoupled Learning Network for 3D hand pose estimation from a single depth image. It employs a Finger Topology Constraint module that uses local kinematic representations of three consecutive finger joints to better model distal joint relationships and handle occlusion. The architecture also decouples 2D joint localization from depth estimation in a hierarchical multitask framework, reducing feature interference and improving accuracy on benchmark datasets such as ICVL, NYU, and MSRA.

By Jun Lu, Zhenming Chen, Lin Chen, Kanlun Tan, Xiaoling Li, Qiao Liu
arXiv Computer Vision
Sep 7

MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision

MINT is a foundation model that directly predicts world-space two-hand trajectories from egocentric RGB video, jointly estimating camera motion, hand states, and hand presence in a single spatiotemporal representation. It uses an open-source labeling pipeline, EGOPIPELINE, to generate large-scale pseudo-labels for pretraining, followed by fine-tuning on a small set of high-quality joint annotations. The model outperforms existing multi-stage approaches in accuracy and speed, and generalizes zero‑shot to unseen egocentric datasets.

By Zijie Zhu, Weiren Cai, Yizhou Wang, Zhenjie Yang, Yide Liu, Jiahao Chen, Guanqi He
arXiv Computer Vision
Sep 16

MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild

MEgoVista is an offline pipeline that converts a single unprepared egocentric video into metric two‑hand and head motion within a gravity‑aligned world frame. It uniquely reconstructs motion in environments beyond studio volumes, uses calibrated stereo for absolute scale, and evaluates its outputs against independent optical capture to audit accuracy. The system thus expands the settings where high‑fidelity hand‑motion labels can be generated from natural, head‑worn recordings.

By Jiangong Xiao (Northwestern Polytechnical University), Zhihao Zhang (Xi'an Jiaotong University), Yifei Dong (Maniformer), Chao Ma (Maniformer), Zhouyi Jin (Maniformer), Zhiwen Hou (Maniformer), Li Liu (Maniformer), Weihuang Chen (Xi'an Jiaotong University), Hongbin Sun (Xi'an Jiaotong University), Maoqing Yao (Maniformer)
arXiv Computer Vision
Sep 18

Monocular Visual Odometry without Calibration or Test-time Optimization

The paper introduces CalfVO, a monocular visual odometry system that operates without camera intrinsics, test‑time optimization, bundle adjustment, or loop closure. Using a transformer, it predicts relative poses with separate rotation and translation confidences over overlapping image windows, then aggregates these predictions via a confidence‑weighted module to produce a single trajectory. CalfVO achieves the highest accuracy among calibration‑free methods across five benchmarks and runs at 53 FPS, outperforming all baselines.

By Vladimir Yugay, Duy-Kien Nguyen, Theo Gevers, Cees G. M. Snoek, Martin R. Oswald
arXiv Computer Vision
Sep 4

VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues

VI3 is a model‑agnostic framework that grounds pretrained 3D foundation models (3DFMs) by using inertial measurement unit (IMU) data to provide metric scale. It initializes and preintegrates IMU readings to create a metric motion reference, which is then used to recover the scale of 3DFM outputs. The approach includes adaptable anchoring strategies for different 3DFM architectures and demonstrates scale recovery on synthetic and real aerial datasets without ground‑truth supervision.

By Ernesto Lozano, Alberto Jaenal, Javier Civera