← Back to all news
arXiv Computer Vision By Xianghui Xie, Bowen Wen, Yan Chang, Hesam Rabeti, Jiefeng Li, Ye Yuan, Gerard Pons-Moll, Stan Birchfield

CARI4D: Category Agnostic 4D Reconstruction of Human-Object Interaction

Read the original on arXiv Computer Vision →

CARI4D is a category‑agnostic method that reconstructs spatially and temporally consistent 4D human‑object interactions from monocular RGB videos at metric scale. It introduces a pose hypothesis selection algorithm that integrates predictions from foundation models, refines them via a learned render‑and‑compare paradigm, and reasons about contacts to satisfy physical constraints. Experiments demonstrate a 38% improvement on in‑distribution data and 36% on unseen data compared to prior work, and the model generalizes to unseen categories, enabling zero‑shot application to internet videos.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv AI
Jun 29

HAT-4D: Lifting Monocular Video for 4D Multi-Object Interactions via Human-Agent Collaboration

arXiv:2606. 28215v1 Announce Type: cross Abstract: Extracting dynamic 4D object interactions from massive, in-the-wild monocular videos offers a highly efficient data collection pathway for scaling Embodied AI and training VLAs.

By Jiaxin Li, Yuxiang Wu, Zhenkai Zhang, Xinrui Shi, Haoyuan Wang, Yichen Zhao, Su Linxiang, Chenyang Yu, Mingyu Zhang, Yifan Ding, Boran Wen, Li Zhang, Ruiyang Liu, Yong-Lu Li
agentsroboticsfine-tuningbenchmarkssafety
More like this →
arXiv AI
Sep 24

MessyKitchens: Contact-rich object-level 3D scene reconstruction

MessyKitchens introduces a new dataset of cluttered real-world kitchen scenes with detailed 3D object shapes, poses, and accurate contact information. The authors extend the SAM 3D single-object reconstruction method with a Multi-Object Decoder (MOD) to jointly reconstruct entire scenes, achieving better registration accuracy and reduced inter-object penetration compared to prior work. The dataset, benchmark, code, and pretrained models will be publicly released on the project website.

By Junaid Ahmed Ansari, Ran Ding, Fabio Pizzati, Ivan Laptev
computer-visionroboticsbenchmarks
More like this →