XM4D is a new framework for accurate 4D reconstruction that separates camera motion estimation from non‑rigid deformation. Both stages are cast as structured quadratically constrained quadratic programs (QCQPs) with semidefinite programming (SDP) relaxations, enabling certifiable global optimality. The method uses GPU‑accelerated Burer‑Monteiro solvers, initializes dynamic Gaussian splatting for refinement, and achieves state‑of‑the‑art performance on seven benchmarks.
By Haoyu Han, Jack Benarroch Jedlicki, Jiahui Lei, Heng Yang
arXiv:2610.28351v1 Announce Type: cross
Abstract: Reconstructing dynamic 3D scenes from monocular video requires inferring motion from noisy and intermittently visible observations. Long-range tracks...
By Yuanxiang Ni, Xianliang Huang, Ruihan Hou, Feng Xie, Hao Zhang
Kineo is a fully automatic, calibration‑free pipeline that performs markerless motion capture using unsynchronized, uncalibrated consumer‑grade RGB cameras. It uses 2D keypoints from existing detectors to jointly calibrate cameras (including distortion), reconstruct 3D keypoints, and generate dense scene pointmaps at metric scale. The method introduces confidence‑aware subsampling, graph‑based optimization, and a pairwise reprojection consistency score to achieve robust calibration and accurate metric scale recovery, achieving significant error reductions on EgoHumans and Human3.6M datasets while remaining computationally efficient.
By Charles Javerliat, Pierre Raimbaud, Guillaume Lavou\'e
The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that avoids pairwise estimation by using a foundation‑then‑refinement paradigm. In the foundation stage, it recovers metrically consistent global poses by grounding scale‑ambiguous predictions from visual geometry foundation models against metric depth. The refinement stage employs voxelized spatial hashing and IRLS‑based bundle adjustment to efficiently refine poses, achieving high accuracy and computational efficiency across indoor, object‑centric, and outdoor datasets.
The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that replaces the traditional pairwise‑then‑global pipeline. It employs a foundation‑then‑refinement paradigm, using visual geometry foundation models to directly recover metrically consistent global poses and then refining them with voxelized spatial hashing and IRLS‑based bundle adjustment. Experiments on indoor, object‑centric, and outdoor datasets demonstrate superior registration accuracy and computational efficiency without any training.
By Haobo Jiang, Liang Yu, Jianmin Zheng
arXiv:2611.08436v1 Announce Type: new
Abstract: We introduce SM4RT, a multi-task cascade feed-forward model for dynamic scene reconstruction from RGB videos. While existing feed-forward approaches ty...
By Pang-Chi Lo, Jhao-Syun Lai, Tsung-Wei Ke
Forge4D is a feed‑forward model that reconstructs temporally aligned 4D human representations from uncalibrated sparse‑view videos, enabling both novel view and novel time synthesis. It achieves this by jointly streaming 3D Gaussian reconstruction with dense motion prediction, using learnable state tokens for temporal consistency and a self‑supervised retargeting loss for motion prediction. Extensive experiments confirm its effectiveness on in‑domain and out‑of‑domain datasets.
By Yingdong Hu, Yisheng He, Jinnan Chen, Weihao Yuan, Kejie Qiu, Zehong Lin, Siyu Zhu, Zilong Dong, Steven Hoi, Jun Zhang
arXiv:2603.12064v3 Announce Type: replace
Abstract: We address the challenging problem of dense dynamic scene reconstruction and camera pose estimation from multiple freely moving cameras -- a settin...
By Shuo Sun, Unal Artan, Malcolm Mielle, Achim J. Lilienthaland, Martin Magnusson
Reconstructing humans and their surrounding environments in a globally consistent 4D space is essential for comprehensive perception. However, prior works typically assume single-view inputs or decouple humans, scenes, and cameras, making them unable to recover coherent geometry, stable motion, and physically aligned trajectories.
arXiv:2608.29003v1 Announce Type: cross
Abstract: In dynamic and unstructured environments, conventional SLAM systems generally suffer from significant accuracy degeneration due to their static assum...
By Wenting Wang, Jiaxin Guo, Wenzhen Dong, Yun-Hui Liu, Charlie C. L. Wang, Yeung Yam
TAPVid-MV is a new benchmark for tracking any point in 3D across multiple synchronized camera views. It comprises 284 sequences, 1,142 calibrated camera streams, and 109,769 point tracks, covering indoor and outdoor domains and derived from various modalities such as depth, LiDAR, SLAM, and simulation. The dataset is visually verified, and evaluation shows that current multi‑view trackers do not consistently outperform monocular trackers, highlighting geometry recovery as a key bottleneck.
By Skanda Koppula, Frano Rajic, Abdullah Faiz Ur Rahman, Yi Yang, Ignacio Rocco, Jeet Thakwani, Rishabh Kabra, Andrew Zisserman, Joao Carreira, Siyu Tang, Carl Doersch, Gabriel Brostow
arXiv:2609.36940v1 Announce Type: new
Abstract: Accurate dynamic scene reconstruction is important for robotic perception, where temporally consistent representations of dynamic environments are esse...
By Thai Duy Nguyen, Haitian Zhang, Addison Lin Wang