SituHOI is a large‑scale RGB‑D dataset that captures full‑body human‑object interactions in 16 indoor rooms, comprising 18,429 annotated clips and about 86 hours of activity. The dataset pairs moving‑camera recordings with static scene scans, object geometry, language descriptions, and estimated human and object trajectories, all registered in a shared floor‑aligned frame via a pipeline that integrates camera localization, depth‑based alignment, human mesh recovery, and object tracking. The data enable the FlexHOI‑Bench benchmark for goal‑conditioned joint motion prediction, and a reference predictor, SharedHOI, demonstrates strong performance on world‑space accuracy and human‑object coordination.
whyItMatters":"The dataset provides scalable, scene‑aligned supervision for modeling human‑object interaction, addressing a key limitation of existing datasets and enabling more accurate motion prediction benchmarks."
By Qifan Wang, Qihang Fang, Boao Shi, Yushi Du, Pei Zhou, Siyan Dong, Yanchao Yang
arXiv:2603.12789v3 Announce Type: replace
Abstract: Recent advances in 3D foundation models have enabled joint reconstruction of humans and their surrounding environments. However, combining independ...
By Sangmin Kim, Minhyuk Hwang, Geonho Cha, Dongyoon Wee, Jaesik Park
Kineo is a fully automatic, calibration‑free pipeline that performs markerless motion capture using unsynchronized, uncalibrated consumer‑grade RGB cameras. It uses 2D keypoints from existing detectors to jointly calibrate cameras (including distortion), reconstruct 3D keypoints, and generate dense scene pointmaps at metric scale. The method introduces confidence‑aware subsampling, graph‑based optimization, and a pairwise reprojection consistency score to achieve robust calibration and accurate metric scale recovery, achieving significant error reductions on EgoHumans and Human3.6M datasets while remaining computationally efficient.
By Charles Javerliat, Pierre Raimbaud, Guillaume Lavou\'e
arXiv:2609.01276v1 Announce Type: new
Abstract: Complete 3D perception from egocentric video requires recovering the surrounding scene and the wearer's full-body motion in a shared metric frame. Exis...
By Kai Guan, Minchao Jiang, Ruichen WangLi, Wentao Zhu, Lei Zhang
arXiv:2605.14854v3 Announce Type: replace-cross
Abstract: Human Mesh Recovery (HMR) is fundamentally ambiguous: under occlusion or weak depth cues, multiple 3D bodies can explain the same image evide...
By Patrick Kwon, Chen Chen
Human mesh recovery (HMR) aims to recover 3D human meshes from images. Most existing HMR benchmarks and methods focus on either multi-person reconstruction from a single view or single-person reconstruction from multiple views, where the number of subjects and the scene scale are relatively limited.
arXiv:2610.29936v1 Announce Type: new
Abstract: Recovering metric world-space hand motion from egocentric video supports understanding human interactions and transferring them to embodied agents. Thr...
By Naru Suzuki, Satoshi Ikehata, Takehiko Ohkawa, Yoichi Sato, Shuhei Kurita
Reconstructing humans and their surrounding environments in a globally consistent 4D space is essential for comprehensive perception. However, prior works typically assume single-view inputs or decouple humans, scenes, and cameras, making them unable to recover coherent geometry, stable motion, and physically aligned trajectories.
arXiv:2609.36937v1 Announce Type: cross
Abstract: Human image animation aims to transfer motion from a driving video to subjects in a reference image. Despite remarkable progress in video generation,...
By Sangeyl Lee, Seunghyun Shin, Seungho Park, Wooseok Jeon, Hae-Gon Jeon
arXiv:2610.20124v1 Announce Type: new
Abstract: Human mesh recovery (HMR) provides a geometric foundation for understanding human motion, but accurately reconstructing both body motion and fine hand...
By Zhengjie Xu, Ruihao Gong, Xianglong Liu
arXiv:2606. 11670v1 Announce Type: cross Abstract: Subject-preserving video generation is not solved by frontal-face similarity alone: a generated person must remain recognizable across motion, large viewpoint changes, expression shifts, occlusion, scale variation, and conflicts among text, first-frame, and identity references.
By Zijie Meng, Jiwen Liu, Yufei Liu, Chengzhuo Tong, Xiaoqiang Liu, Yuanxing Zhang, Yulong Xu, Pengfei Wan
arXiv:2606.16569v2 Announce Type: replace
Abstract: Registering two captures of the same indoor space taken at different times underpins persistent spatial memory for robots and AR systems, yet the r...
By Zhiang Chen, Nahyuk Lee, Boyang Sun, Taein Kwon, Marc Pollefeys, Zuria Bauer, Sunghwan Hong