arXiv Computer Vision

Any3R: Feedforward 3D Reconstruction from Any Camera Type

Any3R is a feed‑forward 3D reconstruction model that works with any central camera type, regardless of lens distortion or field‑of‑view limits. It conditions on a dense ray field—unit direction vectors through every pixel—so its positional encoding and loss function are lens‑agnostic. Evaluated on thirteen camera types across three datasets, Any3R consistently outperforms other methods, enabling scalable reconstruction from heterogeneous, crowdsourced imagery.

arXiv Computer Vision
Oct 23

OmniRay: Camera-Agnostic Monocular 3D Reconstruction with Composite Ray Fields

OmniRay is a feed‑forward model for monocular 3D reconstruction that works without assuming a pinhole camera. It predicts a ray direction and a scale‑free radial distance for each pixel using a composite Ray Module consisting of a monotone radial base, a spherical‑harmonic residual, and a free‑form residual. Experiments across various camera types show that OmniRay achieves state‑of‑the‑art performance in camera‑agnostic monocular 3D reconstruction.

By Namitha Guruprasad, Abhay Yadav, Cheng Peng, Rama Chellappa, Anand Bhattad
arXiv Computer Vision
Sep 15

G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity

The paper introduces G-ray, a ray-level relative position encoding for multi-view vision Transformers that remains consistent across different camera projections. By parameterizing rotary phases with camera-local ray angles, G-ray achieves projection-invariant positional consistency and can be integrated with existing encodings without extra learned parameters. Experiments on 3D reconstruction and novel-view synthesis benchmarks show that G-ray improves performance, notably reducing mean pointmap relative error by 45.8% over MapAnything.

By Shuo Zhang, Xin Su, Wei Wang, Jun Liu, Xinrui Zeng, Yongsen Chen, Chenjie Wang, Guibo Zhu, Jinqiao Wang, Bin Luo, Liangpei Zhang
arXiv Computer Vision
Oct 23

HiP3R: Hierarchical Pose Graphs for Long-Horizon 3D Reconstruction

HiP3R introduces a hierarchical pose graph approach for long‑horizon 3D reconstruction, addressing the trade‑off between chunk‑level and frame‑level optimization. It first builds a robust chunk‑level Sim(3) graph to set the global layout and scale, then fixes this layout while estimating a single SE(3) camera pose per frame to merge overlapping predictions into a unified trajectory. Experiments on multiple benchmarks show that HiP3R improves camera trajectories and 3D reconstruction quality for both chunk‑based and streaming backends without extra training.

By Zunnan Xu, Shangchen Zhou, Yihang Luo, Chen Change Loy
arXiv Computer Vision
Aug 31

GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping

GeoFF3D is a new feed‑forward 3D reconstruction method designed for large‑scale UAV mapping. It uses a coordinate‑anchored model that predicts camera poses and dense point maps directly in a gravity‑aligned Z‑up metric frame, while a spatial large‑scale reconstruction framework (SLRF) partitions images into overlapping chunks, propagates shared‑view priors, and aggregates local reconstructions hierarchically. Across nine aerial mapping blocks, GeoFF3D achieves the best average reconstruction quality, improving F@5 from 0.829 to 0.877, and can reconstruct 2,000 images in about five minutes.

By Xiang Yang, Yongli Wang, Yunsheng Zhang
arXiv AI
6d ago

OmniShowcase: Omnidirectional Subject-Consistent Video Generation from Multi-View Images

OmniShowcase introduces a method for generating omnidirectional videos of a specific subject from a handful of multi‑view images. It combines an automated data‑synthesis pipeline that creates training videos with diverse camera trajectories driven by the subject’s geometry, and a geometry‑conditioning technique that supplies the model with surface‑normal maps reconstructed from the reference views. The authors release Showcase‑4K, a large corpus of 3D‑asset‑based videos with 12 camera motions and 88 trajectory configurations, and ShowcaseBench, a held‑out evaluation set with source meshes and camera parameters.

By Junyeong Ahn, Geonwoo Kim, Kinam Kim, Gihwi Kim, Hoonjin Jung, Hyojin Jang, Jaegul Choo
arXiv Computer Vision
Sep 22

Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation

The paper proposes a new sequence-to-sequence formulation for multi-view stereo (MVS) that jointly predicts 3D geometry for all input views using a global transformer architecture. It introduces ray‑map embeddings to inject camera parameters into image tokens and a unified global cost volume to capture 3D structure across all views. Experiments on public benchmarks demonstrate state‑of‑the‑art performance, outperforming both traditional MVS and feed‑forward reconstruction baselines.

By Aoxiang Fan, Corentin Dumery, Nicolas Talabot, Pascal Fua