XM4D is a new framework for accurate 4D reconstruction that separates camera motion estimation from non‑rigid deformation. Both stages are cast as structured quadratically constrained quadratic programs (QCQPs) with semidefinite programming (SDP) relaxations, enabling certifiable global optimality. The method uses GPU‑accelerated Burer‑Monteiro solvers, initializes dynamic Gaussian splatting for refinement, and achieves state‑of‑the‑art performance on seven benchmarks.
Accurate 4D reconstruction remains challenging: jointly estimating camera motion, scene geometry, and non-rigid deformation entails highly nonconvex optimization, making global optimality difficult to...
arXiv:2610.28351v1 Announce Type: cross Abstract: Reconstructing dynamic 3D scenes from monocular video requires inferring motion from noisy and intermittently visible observations. Long-range tracks...
Kineo is a fully automatic, calibration‑free pipeline that performs markerless motion capture using unsynchronized, uncalibrated consumer‑grade RGB cameras. It uses 2D keypoints from existing detectors to jointly calibrate cameras (including distortion), reconstruct 3D keypoints, and generate dense scene pointmaps at metric scale. The method introduces confidence‑aware subsampling, graph‑based optimization, and a pairwise reprojection consistency score to achieve robust calibration and accurate metric scale recovery, achieving significant error reductions on EgoHumans and Human3.6M datasets while remaining computationally efficient.
The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that replaces the traditional pairwise‑then‑global pipeline. It employs a foundation‑then‑refinement paradigm, using visual geometry foundation models to directly recover metrically consistent global poses and then refining them with voxelized spatial hashing and IRLS‑based bundle adjustment. Experiments on indoor, object‑centric, and outdoor datasets demonstrate superior registration accuracy and computational efficiency without any training.
The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that avoids pairwise estimation by using a foundation‑then‑refinement paradigm. In the foundation stage, it recovers metrically consistent global poses by grounding scale‑ambiguous predictions from visual geometry foundation models against metric depth. The refinement stage employs voxelized spatial hashing and IRLS‑based bundle adjustment to efficiently refine poses, achieving high accuracy and computational efficiency across indoor, object‑centric, and outdoor datasets.
Forge4D is a feed‑forward model that reconstructs temporally aligned 4D human representations from uncalibrated sparse‑view videos, enabling both novel view and novel time synthesis. It achieves this by jointly streaming 3D Gaussian reconstruction with dense motion prediction, using learnable state tokens for temporal consistency and a self‑supervised retargeting loss for motion prediction. Extensive experiments confirm its effectiveness on in‑domain and out‑of‑domain datasets.
arXiv:2611.08436v1 Announce Type: new Abstract: We introduce SM4RT, a multi-task cascade feed-forward model for dynamic scene reconstruction from RGB videos. While existing feed-forward approaches ty...
arXiv:2610.34403v1 Announce Type: new Abstract: Non-rigid structure from motion (NRSfM) aims to recover camera motion and time-varying 3D shape from tracked 2D image measurements. Recent high-perform...
NoPo4D is a feed‑forward system that reconstructs dynamic 3D scenes from unposed multi‑view videos by using 4D Gaussian splatting. It introduces a velocity decomposition that separates per‑pixel image‑plane shifts from depth changes, enabling supervision with pseudo optical flow and avoiding the need for accurate camera poses or 3D motion ground truth. The method also employs a bidirectional motion encoder and view‑dependent opacity to improve cross‑view and cross‑timestep alignment, achieving state‑of‑the‑art results on multiple benchmarks while being much faster than per‑scene optimization approaches.
arXiv:2608.22102v1 Announce Type: cross Abstract: We present GCA (Gaussian Constitutive Alignment), a framework for learning implicit constitutive laws from monocular dynamic video of deformable obje...
arXiv:2603.12064v3 Announce Type: replace Abstract: We address the challenging problem of dense dynamic scene reconstruction and camera pose estimation from multiple freely moving cameras -- a settin...
The paper introduces a reliability-regulated trajectory optimization framework for progressive COLMAP‑free 3D Gaussian Splatting (3DGS). It uses a self‑supervised bidirectional cycle‑consistency mechanism to control camera trajectory estimation through forward motion propagation and retrospective trajectory correction, thereby reducing error compounding without external priors. Experiments on Tanks and Temples and CO3D‑V2 demonstrate improved camera trajectory accuracy and novel‑view rendering quality compared to existing unposed baselines.