arXiv Computer Vision

TurboVGGT: Fast Visual Geometry Reconstruction with Adaptive Alternating Attention

arXiv AI
Sep 10

UniQueR: Unified Query-based Feedforward 3D Reconstruction

UniQueR is a unified query‑based feedforward framework that reconstructs 3D scenes from unposed images by treating reconstruction as a sparse 3D query inference problem. It learns a compact set of 3D anchor points that serve as explicit geometric queries, allowing the network to infer scene structure—including occluded geometry—in a single forward pass. By encoding spatial and appearance priors directly in global 3D space and using a decoupled cross‑attention design, UniQueR achieves strong geometric expressiveness while reducing memory and computational cost, outperforming state‑of‑the‑art feedforward methods on Mip‑NeRF 360 and VR‑NeRF with far fewer primitives.

By Chensheng Peng, Quentin Herau, Jiezhi Yang, Yichen Xie, Yihan Hu, Wenzhao Zheng, Matthew Strong, Masayoshi Tomizuka, Wei Zhan
arXiv Computer Vision
Sep 21

VGGT-CAD: Reconstructing Parametric CAD 3D Model with Geometric Grounding

VGGT-CAD is a geometry‑aware framework that reconstructs parametric CAD 3D models from single and multi‑view images. It incorporates pretrained 3D geometric priors by encoding camera parameters as condition tokens and jointly modeling them with image tokens. The method introduces a variable‑view cross‑view context aggregation module and a training‑free geometry‑aware view selection strategy, and decodes the learned representation into CAD command sequences using a non‑autoregressive decoder. Additionally, VideoCAD, a large‑scale multi‑view video benchmark derived from existing CAD data, is presented to evaluate the approach.

By Chunan Yu, Tianrun Chen, Fu Shen, Cheng Chen, Lanyun Zhu, Yang Yang
arXiv Computer Vision
Sep 22

Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation

The paper proposes a new sequence-to-sequence formulation for multi-view stereo (MVS) that jointly predicts 3D geometry for all input views using a global transformer architecture. It introduces ray‑map embeddings to inject camera parameters into image tokens and a unified global cost volume to capture 3D structure across all views. Experiments on public benchmarks demonstrate state‑of‑the‑art performance, outperforming both traditional MVS and feed‑forward reconstruction baselines.

By Aoxiang Fan, Corentin Dumery, Nicolas Talabot, Pascal Fua
arXiv Computer Vision
Aug 31

Video Generative Models as Geometry Learner

The paper introduces GeoNeXt, a framework that repurposes pretrained video generative models for geometry estimation by framing it as a next‑frame prediction task. Unlike prior methods that either train separate depth/normal models or fine‑tune image diffusion backbones, GeoNeXt jointly models images and geometric targets, leveraging the structured knowledge of video models for more data‑efficient learning. Experiments show zero‑shot monocular depth and surface normal estimation that outperforms existing generative approaches and rivals discriminative state‑of‑the‑art methods while using far less training data.

By Haosen Yang, Jifei Song, Zhensong Zhang, Xiatian Zhu, Jiankang Deng
arXiv Machine Learning
Oct 12

Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction

Zebra3D introduces a layerwise sparse‑linear hybrid attention framework that enhances the efficiency of pretrained 3D foundation models without requiring training from scratch. By assigning linear‑centered attention to tolerant early stages and tile‑sparse attention to sensitive middle‑to‑late stages, it preserves context through landmark summaries and enables training‑free conversion via closed‑form affine fitting. Across multiple backbones, Zebra3D achieves strong reconstruction and camera‑pose accuracy with high attention sparsity, delivering up to 7.1× speedups at 1,024 views and maintaining performance close to dense counterparts after optional post‑conversion training.

By Utkarsh Saxena, Ruijing Yang, Mehdi Rezagholizadeh, Akash Haridas, Vikram Appia, Emad Barsoum