arXiv Computer Vision

Generalizable Neural Reconstruction of High-Fidelity Surfaces via Sparse Volumetric Representations

The paper introduces SVRecon, a generalizable neural surface reconstruction framework that uses sparse volumetric representations to achieve high-resolution 3D reconstruction. It employs a two-stage architecture: first predicting occupied voxels with an occupancy network, then rendering only within those regions using specialized sparse algorithms. This approach allows reconstruction at resolutions up to 512³ on 32 GB hardware, producing smoother and more precise surfaces, especially in sparse-view scenarios.

arXiv Machine Learning
Jul 2

Efficient Compression of Structured and Unstructured Volumes via Learned 3D Gaussian Representation

arXiv:2607. 01164v1 Announce Type: new Abstract: Recent work has shown that implicit neural representations (INRs) can be trained to effectively compress structured and unstructured volume data, allowing for direct data querying with a reduced memory footprint.

By Landon Dyken, Sharmistha Chakrabarti, Nathan Debardeleben, Steve Petruzza, Qi Wu, Will Usher, Sidharth Kumar
Hugging Face Trending Papers
Sep 3

Sparse auto-regressive modeling for scene generation from multi-view images

The paper introduces SPAR3S, a sparse voxel‑aligned 3D latent generative model that completes 3D scenes from sparse, unconstrained multi‑view images. By representing only occupied voxels in a compact latent space and training a masked autoregressive transformer with photometric supervision via differentiable 3D Gaussian Splatting, the method predicts missing latent tokens and spatial support, enabling efficient and spatially consistent generation of unseen regions. Experiments on synthetic indoor scenes and RealEstate10k demonstrate higher novel‑view quality and real‑world applicability compared to prior work.

arXiv AI
Sep 10

UniQueR: Unified Query-based Feedforward 3D Reconstruction

UniQueR is a unified query‑based feedforward framework that reconstructs 3D scenes from unposed images by treating reconstruction as a sparse 3D query inference problem. It learns a compact set of 3D anchor points that serve as explicit geometric queries, allowing the network to infer scene structure—including occluded geometry—in a single forward pass. By encoding spatial and appearance priors directly in global 3D space and using a decoupled cross‑attention design, UniQueR achieves strong geometric expressiveness while reducing memory and computational cost, outperforming state‑of‑the‑art feedforward methods on Mip‑NeRF 360 and VR‑NeRF with far fewer primitives.

By Chensheng Peng, Quentin Herau, Jiezhi Yang, Yichen Xie, Yihan Hu, Wenzhao Zheng, Matthew Strong, Masayoshi Tomizuka, Wei Zhan
arXiv Machine Learning
Sep 4

Sparse auto-regressive modeling for scene generation from multi-view images

The paper introduces SPAR3S, a sparse voxel‑aligned 3D latent generative model that completes 3D scenes from sparse, unconstrained multi‑view images. It learns a compact voxel‑aligned latent space using photometric supervision via differentiable 3D Gaussian Splatting, and employs a masked autoregressive transformer to predict missing voxel occupancy and latent tokens. Experiments on synthetic indoor scenes and RealEstate10k show that SPAR3S achieves higher novel‑view quality than prior methods and generalizes to real‑world data.

By Thomas Lucas, Maxime Pietrantoni, Philippe Weinzaepfel, Wonjune Cho, Bardienus Pieter Duisterhof, Vincent Leroy, Jerome Revaud
arXiv Computer Vision
Aug 28

ReSplat: Learning Recurrent Gaussian Splatting

ReSplat introduces a recurrent Gaussian splatting model that iteratively refines 3D Gaussians using the rendering error as a feedback signal, avoiding explicit gradient computation. The method starts from a compact reconstruction in a subsampled space, producing far fewer Gaussians than prior per‑pixel models, which reduces computational cost. Experiments on multiple datasets, view counts, and resolutions show state‑of‑the‑art performance with faster rendering speeds.

By Haofei Xu, Daniel Barath, Andreas Geiger, Marc Pollefeys
arXiv Machine Learning
Jul 31

A Query-Efficient Stochastic Volume Rendering Framework for Time-Varying Implicit Neural Volumes

arXiv:2607. 28047v1 Announce Type: cross Abstract: Time-varying implicit neural representations (INRs) provide a compact representation of scientific volumes and, for modalities such as dynamic X-ray computed tomography (CT), are often the only practical way to represent the data.

By Alper Sahistan, Haichao Miao, Zhimin Li, Peer-Timo Bremer, Joshua A Levine, Valerio Pascucci