SituHOI is a large‑scale RGB‑D dataset that captures full‑body human‑object interactions in 16 indoor rooms, comprising 18,429 annotated clips and about 86 hours of activity. The dataset pairs moving‑camera recordings with static scene scans, object geometry, language descriptions, and estimated human and object trajectories, all registered in a shared floor‑aligned frame via a pipeline that integrates camera localization, depth‑based alignment, human mesh recovery, and object tracking. The data enable the FlexHOI‑Bench benchmark for goal‑conditioned joint motion prediction, and a reference predictor, SharedHOI, demonstrates strong performance on world‑space accuracy and human‑object coordination.
whyItMatters":"The dataset provides scalable, scene‑aligned supervision for modeling human‑object interaction, addressing a key limitation of existing datasets and enabling more accurate motion prediction benchmarks."
By Qifan Wang, Qihang Fang, Boao Shi, Yushi Du, Pei Zhou, Siyan Dong, Yanchao Yang
arXiv:2603.12789v3 Announce Type: replace
Abstract: Recent advances in 3D foundation models have enabled joint reconstruction of humans and their surrounding environments. However, combining independ...
By Sangmin Kim, Minhyuk Hwang, Geonho Cha, Dongyoon Wee, Jaesik Park
Kineo is a fully automatic, calibration‑free pipeline that performs markerless motion capture using unsynchronized, uncalibrated consumer‑grade RGB cameras. It uses 2D keypoints from existing detectors to jointly calibrate cameras (including distortion), reconstruct 3D keypoints, and generate dense scene pointmaps at metric scale. The method introduces confidence‑aware subsampling, graph‑based optimization, and a pairwise reprojection consistency score to achieve robust calibration and accurate metric scale recovery, achieving significant error reductions on EgoHumans and Human3.6M datasets while remaining computationally efficient.
By Charles Javerliat, Pierre Raimbaud, Guillaume Lavou\'e
arXiv:2609.01276v1 Announce Type: new
Abstract: Complete 3D perception from egocentric video requires recovering the surrounding scene and the wearer's full-body motion in a shared metric frame. Exis...
By Kai Guan, Minchao Jiang, Ruichen WangLi, Wentao Zhu, Lei Zhang
arXiv:2605.14854v3 Announce Type: replace-cross
Abstract: Human Mesh Recovery (HMR) is fundamentally ambiguous: under occlusion or weak depth cues, multiple 3D bodies can explain the same image evide...
By Patrick Kwon, Chen Chen
Human mesh recovery (HMR) aims to recover 3D human meshes from images. Most existing HMR benchmarks and methods focus on either multi-person reconstruction from a single view or single-person reconstruction from multiple views, where the number of subjects and the scene scale are relatively limited.