arXiv Computer Vision

HiQGS: Hierarchical Spatiotemporal Querying for Feed-Forward Gaussian Reconstruction

HiQGS is a query-based hierarchical framework that performs feed-forward Gaussian reconstruction from sparse monocular frames. It introduces a Hierarchical Spatiotemporal Encoder that organizes multi-resolution visual features by image location, observation time, and camera pose, preserving complementary appearance and structural cues. A Time-Adaptive Decoder then uses target timestamp queries to retrieve relevant spatiotemporal evidence and predict the corresponding Gaussian scene state, achieving strong rendering quality and geometric accuracy on static and dynamic scene benchmarks.

arXiv AI
Sep 10

UniQueR: Unified Query-based Feedforward 3D Reconstruction

UniQueR is a unified query‑based feedforward framework that reconstructs 3D scenes from unposed images by treating reconstruction as a sparse 3D query inference problem. It learns a compact set of 3D anchor points that serve as explicit geometric queries, allowing the network to infer scene structure—including occluded geometry—in a single forward pass. By encoding spatial and appearance priors directly in global 3D space and using a decoupled cross‑attention design, UniQueR achieves strong geometric expressiveness while reducing memory and computational cost, outperforming state‑of‑the‑art feedforward methods on Mip‑NeRF 360 and VR‑NeRF with far fewer primitives.

By Chensheng Peng, Quentin Herau, Jiezhi Yang, Yichen Xie, Yihan Hu, Wenzhao Zheng, Matthew Strong, Masayoshi Tomizuka, Wei Zhan
arXiv Computer Vision
Oct 19

LonGaussian: Tracking Foundation Priors for Long-Context Feedforward Gaussian Reconstruction

LonGaussian is a streaming feed‑forward framework that reconstructs compact, globally renderable Gaussian scenes from long image sequences with known intrinsics and unknown camera poses. It decodes long‑context geometric features into dense Gaussians, links repeated observations via multi‑frame point tracks, and consolidates predictions with a learned merger. Rendered‑depth consistency filtering removes incorrectly occluding Gaussians, leading to improved novel‑view rendering quality on DL3DV and RealEstate10K benchmarks while using fewer Gaussians than baseline methods.

By Zhoufeng Xie, Guanjun Wu, Shuai Zhang, Xinggang Wang, Wenyu Liu
arXiv Computer Vision
5d ago

No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videos

NoPo4D is a feed‑forward system that reconstructs dynamic 3D scenes from unposed multi‑view videos by using 4D Gaussian splatting. It introduces a velocity decomposition that separates per‑pixel image‑plane shifts from depth changes, enabling supervision with pseudo optical flow and avoiding the need for accurate camera poses or 3D motion ground truth. The method also employs a bidirectional motion encoder and view‑dependent opacity to improve cross‑view and cross‑timestep alignment, achieving state‑of‑the‑art results on multiple benchmarks while being much faster than per‑scene optimization approaches.

By Matteo Balice, Yanik Kunzi, Chenyangguang Zhang, Matteo Matteucci, Marc Pollefeys, Sunghwan Hong
Hugging Face Trending Papers
Jul 27

GenSplatCodec: Feed-Forward Gaussian Splatting Compression via One-Step Diffusion

Feed-forward 3D Gaussian Splatting (3DGS) enables scalable scene reconstruction without per-scene optimization, yet produces dense Gaussians that are costly to store and transmit. Existing feed-forward Gaussian compression methods formulate decoding as deterministic representation recovery, which becomes inadequate at low bitrates when high-frequency textures and view-dependent appearance are discarded.

arXiv Computer Vision
Sep 3

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation

RoGe is a new end‑to‑end framework for novel view synthesis that jointly learns an implicit 3D scene representation and a video diffusion model. It eliminates the need for explicit 3D intermediates by querying the implicit scene with camera rays to produce geometric features that condition the diffusion model. Experiments on DL3DV show that RoGe surpasses reconstruction‑based, generation‑based, and hybrid baselines in image quality and temporal consistency, and ablations confirm the benefits of ray‑queried features and joint training.

By Xiaolei Lang, Ze Kang, Zehao Huang, Naiyan Wang
Hugging Face Trending Papers
Aug 3

D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting

Dynamic 4D Gaussian Splatting has emerged as an efficient representation for dynamic novel view synthesis through explicit scene modeling and real-time rendering. However, existing methods typically require dense multi-view videos for sufficient geometric constraints, making capture expensive and limiting sparse-camera deployment.