arXiv:2609.24482v1 Announce Type: new Abstract: Monocular 3D human pose estimation (HPE) remains challenging due to depth ambiguity, occlu- sions, and the need for temporal consistency. While multi-v...
arXiv:2609.01276v1 Announce Type: new Abstract: Complete 3D perception from egocentric video requires recovering the surrounding scene and the wearer's full-body motion in a shared metric frame. Exis...
arXiv:2610.29936v1 Announce Type: new Abstract: Recovering metric world-space hand motion from egocentric video supports understanding human interactions and transferring them to embodied agents. Thr...
The paper introduces EgoGenEval, a new benchmark that assesses the physical consistency of visual generators under ego‑motion by measuring Camera Motion Grounding and Scene State Preservation across 1,400 cases and 2,360 target views. Experiments on 16 pose‑free generators and two pose‑conditioned references show that current models struggle to maintain both camera motion and scene state simultaneously. A follow‑up study using EgoGen‑Train demonstrates that pairwise supervision does not effectively improve both metrics together, suggesting the need for a trajectory‑centric training paradigm.
The paper introduces EgoGenEval, a benchmark that assesses visual generators’ physical consistency during ego‑motion by measuring Camera Motion Grounding and Scene State Preservation across 1,400 cases and 2,360 target views. It shows that current pose‑free models struggle to maintain both camera motion and scene state, and that pairwise supervision in training does not simultaneously improve these aspects. The authors suggest a trajectory‑centric approach that couples self‑conditioned rollouts with explicit pose and visibility supervision to address these limitations.
arXiv:2609.08636v1 Announce Type: cross Abstract: Egocentric 4D interaction forecasting aims to anticipate both where future interactions will occur in 3D and how the human body will move to realize...
MINT is a foundation model that directly predicts world-space two-hand trajectories from egocentric RGB video, jointly estimating camera motion, hand states, and hand presence in a single spatiotemporal representation. It uses an open-source labeling pipeline, EGOPIPELINE, to generate large-scale pseudo-labels for pretraining, followed by fine-tuning on a small set of high-quality joint annotations. The model outperforms existing multi-stage approaches in accuracy and speed, and generalizes zero‑shot to unseen egocentric datasets.
EgoHand is a monocular 3D hand reconstruction model that sets new state‑of‑the‑art results on egocentric video. It is trained on a curated 14‑million‑image corpus that blends synthetic data, in‑the‑wild video, and multi‑camera motion capture to balance diversity and supervision quality. The model uses SOMA‑Hand as its parametric representation, processes 2D hand crops with a transformer encoder, and incorporates camera cues and an auxiliary 2D branch to enhance geometric consistency and image alignment, achieving low inference latency and strong out‑of‑domain generalization on benchmarks such as HOT3D, ARCTIC, and H2O.
arXiv:2607. 17790v1 Announce Type: cross Abstract: Egocentric devices, such as wearable front-facing cameras, provide a unique perspective for capturing the continuous interaction between a human viewer and the surrounding environment.
arXiv:2605.18553v2 Announce Type: replace-cross Abstract: Recovering world space 4D motion of two interacting hands from egocentric video is a fundamental capability for supervising robot policy lear...
arXiv:2610.23039v1 Announce Type: new Abstract: Feed-forward Gaussian models have made novel view synthesis almost instantaneous. Feed-forward methods predict Gaussians directly, either in two stages...
arXiv:2608.30521v1 Announce Type: new Abstract: Conventional algebraic triangulation solves 3D human pose estimation (HPE) from multi-view 2D keypoints. The typical approach, decoding 2D keypoints fr...