arXiv Computer Vision By Yibin Zhao, Yihan Pan, Yangwen Li, Jun Nan, Jianjun Yi

VoxelTTO: Voxel-Aligned Feed-Forward 3D Gaussian Splatting with Test-Time Optimization

Read the original on arXiv Computer Vision →

VoxelTTO is a feed‑forward framework that reconstructs 3D Gaussian splatting scenes from multiple images by aggregating dense image features into a global voxel representation and decoding Gaussians from voxel features, thereby eliminating the pixel‑to‑Gaussian correspondence. It incorporates test‑time optimization with lightweight LoRA modules to adapt to known camera parameters while keeping the pretrained visual foundation model frozen. The method replaces standard rasterization with stochastic solid volume rendering, improving geometric fidelity, and demonstrates superior RGB‑D novel‑view synthesis and camera‑pose estimation on Replica, Tanks and Temples, and DTU datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Hugging Face Trending Papers
5d ago

OctreeSplat: Hierarchical Octree-Guided Feed-Forward Gaussian Splatting

OctreeSplat introduces a hierarchical octree-guided feed‑forward Gaussian splatting method that extracts multi‑view features and geometric priors from a frozen visual foundation model. By constructing a hierarchical octree and predicting densification scores, it allocates Gaussian primitives at spatially varying densities, improving depth rendering and surface reconstruction. The approach requires only 76 million additional parameters and 35 GPU‑hours to train, and demonstrates competitive RGB view synthesis, depth synthesis, and surface reconstruction on Replica, TUM, Tanks and Temples, and DTU datasets while reducing the number of Gaussian primitives needed.

arXiv Computer Vision
Oct 28

GeoGSplat: Geometry-Grounded Non-Pixel-Aligned Gaussian Splatting

GeoGSplat introduces a geometry‑grounded, feed‑forward Gaussian splatting framework that avoids the pixel‑aligned prediction bottleneck by using a fixed number of Gaussians. A dual‑branch encoder builds coarse 3D anchors and fine triplane features, while a hierarchical decoder progressively generates dense 3D points and Gaussian primitives for reconstruction and novel view synthesis. The method outperforms state‑of‑the‑art pixel‑aligned and non‑pixel‑aligned splatting techniques on DTU and NRGBD datasets, especially when rendering views far from the input cameras.

By Jiale Wang, Chen Zhao, Haoyang Zhang, Yanhao Wu, Fei He, Yanhu Shan, Rui Wu, Wei Ke, Tong Zhang
arXiv Computer Vision
Oct 19

LonGaussian: Tracking Foundation Priors for Long-Context Feedforward Gaussian Reconstruction

LonGaussian is a streaming feed‑forward framework that reconstructs compact, globally renderable Gaussian scenes from long image sequences with known intrinsics and unknown camera poses. It decodes long‑context geometric features into dense Gaussians, links repeated observations via multi‑frame point tracks, and consolidates predictions with a learned merger. Rendered‑depth consistency filtering removes incorrectly occluding Gaussians, leading to improved novel‑view rendering quality on DL3DV and RealEstate10K benchmarks while using fewer Gaussians than baseline methods.

By Zhoufeng Xie, Guanjun Wu, Shuai Zhang, Xinggang Wang, Wenyu Liu
arXiv AI
Oct 31

Aligning Misaligned Benchmarks for Single-View Novel View Synthesis

The paper addresses the lack of standardized evaluation for single‑view novel view synthesis by highlighting the importance of aligning a method’s reference frame with the ground‑truth camera pose. It proposes using traditional 2D‑to‑2D and 2D‑to‑3D image matching to align 3D reconstructions and restricts evaluation to co‑visible regions where a correct ground truth exists. Experiments show that with proper alignment, 3D Gaussian‑based methods reach state‑of‑the‑art performance, and a simple baseline using a video generator and geometry estimator matches specialized novel‑view synthesis models without task‑specific training.

By Yang-Che Tseng, Erqun Dong, Jeong-gi Kwak, Gopal Sharma, Shakiba Kheradmand, Stephan Garbin, Hossam Isack, Kwang Moo Yi