Evaluating deformable 3D reconstruction requires ground truth linking camera motion, surface deformation, material correspondence and image appearance. We introduce the Synthetic Deformable Tubular Be...
arXiv:2603.17068v3 Announce Type: replace
Abstract: Structured 3D representations such as keypoints and meshes offer compact, expressive descriptions of deformable objects, jointly capturing geometri...
By Yeheng Zong, Yizhou Chen, Alexander Bowler, Chia-Tung Yang, Ram Vasudevan
Kineo is a fully automatic, calibration‑free pipeline that performs markerless motion capture using unsynchronized, uncalibrated consumer‑grade RGB cameras. It uses 2D keypoints from existing detectors to jointly calibrate cameras (including distortion), reconstruct 3D keypoints, and generate dense scene pointmaps at metric scale. The method introduces confidence‑aware subsampling, graph‑based optimization, and a pairwise reprojection consistency score to achieve robust calibration and accurate metric scale recovery, achieving significant error reductions on EgoHumans and Human3.6M datasets while remaining computationally efficient.
By Charles Javerliat, Pierre Raimbaud, Guillaume Lavou\'e
CADSplat is a framework that reconstructs photorealistic, geometrically accurate digital twins from fewer than 15 wide‑baseline images by regularizing 3D Gaussian Splatting with an explicit CAD shape prior. It matches segmented object silhouettes to a CAD library to retrieve a suitable model and camera poses, then anchors Gaussian primitives to the model’s surface and jointly optimizes splat parameters, registration, and a non‑rigid deformation field. Experiments on two real‑world datasets show CADSplat outperforms baselines, especially in sparse and self‑occluded scenarios, and its gains mainly stem from constraining splats to a surface rather than the CAD shape itself.
By Kristof Overdulve, Lode Jorissen, Nick Michiels
arXiv:2610.08684v1 Announce Type: new
Abstract: Modern video models can generate realistic videos from real appearance references and proxy renders that specify scene structure, viewpoint changes, an...
By Dicong Qiu, Zhiyuan Xu, Yaosheng Liu, Feng Han, Bo Ye
arXiv:2605.30320v2 Announce Type: replace
Abstract: Existing inverse physics methods recover physical parameters from multi-view videos, where geometric constraints across views resolve scale and 3D...
By Daniel Rho, Jun Myeong Choi, Matthew Thornton, Biswadip Dey, Roni Sengupta
TAPVid-MV is a new benchmark for tracking any point in 3D across multiple synchronized camera views. It comprises 284 sequences, 1,142 calibrated camera streams, and 109,769 point tracks, covering indoor and outdoor domains and derived from various modalities such as depth, LiDAR, SLAM, and simulation. The dataset is visually verified, and evaluation shows that current multi‑view trackers do not consistently outperform monocular trackers, highlighting geometry recovery as a key bottleneck.
By Skanda Koppula, Frano Rajic, Abdullah Faiz Ur Rahman, Yi Yang, Ignacio Rocco, Jeet Thakwani, Rishabh Kabra, Andrew Zisserman, Joao Carreira, Siyu Tang, Carl Doersch, Gabriel Brostow
arXiv:2610.02160v1 Announce Type: new
Abstract: Precise control over camera and object motion is essential for professional video production. Existing methods control objects only coarsely, through i...
By Wei Cao, Hao Zhang, Vikram Voleti, Yuqun Wu, Mallikarjun B R, Shimon Vainer, Mark Boss, Yaoyao Liu
OmniShowcase introduces a method for generating omnidirectional videos of a specific subject from a handful of multi‑view images. It combines an automated data‑synthesis pipeline that creates training videos with diverse camera trajectories driven by the subject’s geometry, and a geometry‑conditioning technique that supplies the model with surface‑normal maps reconstructed from the reference views. The authors release Showcase‑4K, a large corpus of 3D‑asset‑based videos with 12 camera motions and 88 trajectory configurations, and ShowcaseBench, a held‑out evaluation set with source meshes and camera parameters.
By Junyeong Ahn, Geonwoo Kim, Kinam Kim, Gihwi Kim, Hoonjin Jung, Hyojin Jang, Jaegul Choo
GeoFlip is a new benchmark for video generation models that tests their ability to produce physically correct outcomes when the initial geometry of a scene is altered. The benchmark presents 482 pairs of scenes with controlled changes in extent, placement, and mechanism configuration, and evaluates models on event correctness, structural integrity, and similarity to reference videos. Across 16 evaluated models, the best event correctness averaged only 27.98%, highlighting significant gaps in geometry‑sensitive physical reasoning.
By Yuqi Li, Junming Liu, Bowen Hu, Ruize Niu, Huiran Duan, Yingli Tian, Hao Wu
arXiv:2610.42002v2 Announce Type: replace
Abstract: Video generation models synthesize realistic motion, but can they respond correctly to changes in initial geometry? We introduce GeoFlip, a video g...
By Yuqi Li, Junming Liu, Bowen Hu, Ruize Niu, Huiran Duan, Ming-Hsuan Yang, Yingli Tian, Hao Wu
SemGeo-Gen is an unsupervised approach that generates approximate cross‑instance semantic‑geometric correspondences from weakly aligned 3D object collections. It uses coarse category‑level rotation alignment, lifts multi‑view DINOv2 features to 3D, applies continuous piecewise‑affine registration, and prunes matches with semantic consistency to produce 3D correspondences that can be projected into 2D views for scalable supervision. The method achieves high accuracy against human annotations and improves state‑of‑the‑art semantic correspondence models after synthetic pretraining.
By Roy Amoyal, Shira Ifergane, Oren Freifeld