Any3R: Feedforward 3D Reconstruction from Any Camera Type
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Any3R is a feed‑forward 3D reconstruction model that works with any central camera type, regardless of lens distortion or field‑of‑view limits. It conditions on a dense ray field—unit direction vectors through every pixel—so its positional encoding and loss function are lens‑agnostic. Evaluated on thirteen camera types across three datasets, Any3R consistently outperforms other methods, enabling scalable reconstruction from heterogeneous, crowdsourced imagery.
OmniRay is a feed‑forward model for monocular 3D reconstruction that works without assuming a pinhole camera. It predicts a ray direction and a scale‑free radial distance for each pixel using a composite Ray Module consisting of a monotone radial base, a spherical‑harmonic residual, and a free‑form residual. Experiments across various camera types show that OmniRay achieves state‑of‑the‑art performance in camera‑agnostic monocular 3D reconstruction.
We study relative position encoding for multi-view vision Transformers under camera heterogeneity, including varying fields of view (FoVs) or projection models. Existing rotary relative position encod...
The paper introduces G-ray, a ray-level relative position encoding for multi-view vision Transformers that remains consistent across different camera projections. By parameterizing rotary phases with camera-local ray angles, G-ray achieves projection-invariant positional consistency and can be integrated with existing encodings without extra learned parameters. Experiments on 3D reconstruction and novel-view synthesis benchmarks show that G-ray improves performance, notably reducing mean pointmap relative error by 45.8% over MapAnything.
HiP3R introduces a hierarchical pose graph approach for long‑horizon 3D reconstruction, addressing the trade‑off between chunk‑level and frame‑level optimization. It first builds a robust chunk‑level Sim(3) graph to set the global layout and scale, then fixes this layout while estimating a single SE(3) camera pose per frame to merge overlapping predictions into a unified trajectory. Experiments on multiple benchmarks show that HiP3R improves camera trajectories and 3D reconstruction quality for both chunk‑based and streaming backends without extra training.
arXiv:2609.13504v1 Announce Type: new Abstract: Recent developments in feed-forward 3D reconstruction resulted in models which can recover dense scene representations and camera motion solely from an...