Any3R is a feed‑forward 3D reconstruction model that works with any central camera type, regardless of lens distortion or field‑of‑view limits. It conditions on a dense ray field—unit direction vectors through every pixel—so its positional encoding and loss function are lens‑agnostic. Evaluated on thirteen camera types across three datasets, Any3R consistently outperforms other methods, enabling scalable reconstruction from heterogeneous, crowdsourced imagery.
By Jingong Chen, Qingwen Zhang, Youming Deng, Chulwoo Pack, Olaf Wysocki, Boris Jutzi, Kwanghee Won, Kyle Gao
We study relative position encoding for multi-view vision Transformers under camera heterogeneity, including varying fields of view (FoVs) or projection models. Existing rotary relative position encod...
The paper introduces G-ray, a ray-level relative position encoding for multi-view vision Transformers that remains consistent across different camera projections. By parameterizing rotary phases with camera-local ray angles, G-ray achieves projection-invariant positional consistency and can be integrated with existing encodings without extra learned parameters. Experiments on 3D reconstruction and novel-view synthesis benchmarks show that G-ray improves performance, notably reducing mean pointmap relative error by 45.8% over MapAnything.
By Shuo Zhang, Xin Su, Wei Wang, Jun Liu, Xinrui Zeng, Yongsen Chen, Chenjie Wang, Guibo Zhu, Jinqiao Wang, Bin Luo, Liangpei Zhang
arXiv:2609.09394v1 Announce Type: new
Abstract: Recovering metric 3D geometry from monocular images is a fundamental computer vision task, yet current methods remain heavily fragmented by fixed camer...
By Botao Ye, Marc Pollefeys, Ming-Hsuan Yang, Abhijit Kundu
The paper proposes a new sequence-to-sequence formulation for multi-view stereo (MVS) that jointly predicts 3D geometry for all input views using a global transformer architecture. It introduces ray‑map embeddings to inject camera parameters into image tokens and a unified global cost volume to capture 3D structure across all views. Experiments on public benchmarks demonstrate state‑of‑the‑art performance, outperforming both traditional MVS and feed‑forward reconstruction baselines.
By Aoxiang Fan, Corentin Dumery, Nicolas Talabot, Pascal Fua
arXiv:2609.13504v1 Announce Type: new
Abstract: Recent developments in feed-forward 3D reconstruction resulted in models which can recover dense scene representations and camera motion solely from an...
By Tingjun Huang, Dmitry Rudshin, Mathieu Meyer, Pietro Bonazzi, Marc Pollefeys, Emilia Szyma\'nska
The paper introduces GRF-Recon, a framework for stable and scalable feed-forward 3D reconstruction from long monocular image sequences. It combines coarse-to-fine trajectory alignment, lightweight geometric prior injection via LoRA adaptation, and a hybrid-weight sparse ray-field optimization to refine local point clouds while enforcing cross-frame consistency. An efficient trajectory stitching strategy with joint ray-error optimization further reduces accumulated drift, achieving competitive trajectory accuracy compared to SLAM systems while maintaining globally consistent reconstructions in large-scale scenarios.
By Enpeng Li, Yunzhou Zhang, Zhiyao Zhang, Dexuan Lyu, Chenyu Wang, Chiyuan Cui, Cheng Cheng
arXiv:2605.12938v2 Announce Type: replace-cross
Abstract: Video world models should predict future appearance in a way that remains consistent with 3D scene structure, camera motion, and lens geometr...
By Seonghyun Jin, Youngmin Kim, Sunwoo Park, Jong Chul Ye
The paper introduces a feed‑forward novel view synthesis method that works across heterogeneous cameras, such as perspective, fisheye, and panoramic types. It addresses tokenization ambiguity by combining token‑center relative Camera Positional Encodings with local raymaps and a projection‑aware 2D RoPE that aligns positional reasoning across different camera projections. Experiments on ScanNet++ show improved performance over camera‑conditioned baselines and zero‑shot generalization to panoramic views.
By Meng Wei, Cheng Zhang, Boying Li, Yihang Chen, Jianmin Zheng, Hamid Rezatofighi, Jianfei Cai
arXiv:2609.10531v1 Announce Type: new
Abstract: Image-to-3D models can generate visually compelling 3D assets from a single RGB image, but their geometry is often only loosely constrained by the avai...
By Jerred Chen, Simon Weber, Ronald Clark
arXiv:2609.13397v1 Announce Type: new
Abstract: In rendering, a camera is a sampling operator that maps each finite pixel to a bundle of rays. Different camera models change the geometry of this bund...
By Deheng Zhang, Letian Shi, Runyi Yang, Zhendong Li, Lei Sun, Kanzhi Wu, Ajad Chhatkuli, Danda Pani Paudel, Luc Van Gool
GeoPano is a feed‑forward framework that reconstructs geometrically accurate 3D point clouds from a single panoramic image. It introduces a panoramic‑aware attention aggregator with a novel Pano‑Attention mechanism to exploit spherical geometry and reduce cross‑view inconsistencies. A hybrid supervision strategy enforces both fine‑grained local detail in perspective views and global structural coherence in spherical space, leading to superior reconstruction accuracy, consistency, and visual fidelity compared to prior state‑of‑the‑art methods.
By Jing OU, Zidong Cao, Liaoyuan Fan, Zhuoxiao Li, Shuai Zhang, Yinrui Ren, Dongli Wu, Haoang Li, Hui Xiong, Wufan Zhao