arXiv AI
From Where to How: Continuous 4D Interaction Forecasting from Egocentric Video
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computer Vision
22h ago
EgoHSI3R: Online 4D Hand-Scene Interaction Reconstruction from Egocentric Video
arXiv:2610.40832v1 Announce Type: new Abstract: Egocentric videos offer an abundant source of hand-scene interactions for embodied learning, which requires recovering hands, camera, and scene consist...
arXiv Computer Vision
Sep 7
MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision
MINT is a foundation model that directly predicts world-space two-hand trajectories from egocentric RGB video, jointly estimating camera motion, hand states, and hand presence in a single spatiotemporal representation. It uses an open-source labeling pipeline, EGOPIPELINE, to generate large-scale pseudo-labels for pretraining, followed by fine-tuning on a small set of high-quality joint annotations. The model outperforms existing multi-stage approaches in accuracy and speed, and generalizes zero‑shot to unseen egocentric datasets.
arXiv Computer Vision
Oct 21
Decoupling Action from Egocentric Observation for World Simulation
arXiv:2610.27946v1 Announce Type: new Abstract: Egocentric action transfer aims to decouple the semantic action from egocentric observations and reproduce them in new visual contexts, enabling scalab...
arXiv AI
Jul 2
EgoSim: Egocentric World Simulator for Embodied Interaction Generation
arXiv:2604. 01001v2 Announce Type: replace-cross Abstract: We introduce EgoSim, a closed-loop egocentric world simulator that generates spatially consistent interaction videos and persistently updates the underlying 3D scene state for continuous simulation.
arXiv Computer Vision
Oct 21
MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction
arXiv:2606.18558v2 Announce Type: replace Abstract: Motion forecasting is central to visual intelligence: agents must anticipate how objects will move in order to plan actions, reason about physical...
arXiv Computer Vision
Sep 2
Seeing the World and the Self from Egocentric Video
arXiv:2609.01276v1 Announce Type: new Abstract: Complete 3D perception from egocentric video requires recovering the surrounding scene and the wearer's full-body motion in a shared metric frame. Exis...