arXiv Computer Vision

LightFuse: Relightable Interactive Gaussian Scene Reconstruction via Multi-Scan Fusion and 2D Gaussian Ray Tracing

arXiv AI
Jun 3

Ref-DGS: Reflective Dual Gaussian Splatting

arXiv:2603. 07664v3 Announce Type: replace-cross Abstract: The reflective appearance, especially strong and typically near-field specular reflections, poses a fundamental challenge for accurate surface reconstruction and novel view synthesis.

By Ningjing Fan, Yiqun Wang, Dongming Yan, Peter Wonka
Hugging Face Trending Papers
Aug 6

Floating Radiance Networks

Recent advances in neural scene representations enable photorealistic novel-view synthesis, yet most methods remain tightly coupled to a single rendering paradigm, limiting their versatility and integration with conventional graphics workflows. We introduce Floating Radiance Networks (FlaRe), a neural scene representation combining explicit ray-traceable geometry with continuous neural radiance functions.

arXiv Computer Vision
Oct 7

VolS-GS: Relightable Gaussian Splatting with Volumetric Subsurface Scattering

VolS-GS is a relightable Gaussian splatting framework that reconstructs objects from one-light-at-a-time captures and renders them under novel lighting and viewpoints. It addresses the difficulty of modeling non‑local effects such as subsurface scattering by using the spatial support of the Gaussian scene as the domain of a differentiable finite‑volume transport solver, allowing light to propagate through the object's interior. A small network predicts scattering and absorption coefficients for each Gaussian, and the solver redistributes incident light, while a shadow term and regularizer prevent learned shadow and specular terms from dominating the appearance. "whyItMatters":"The approach improves relighting quality on held‑out lights and views across three OLAT benchmarks, demonstrating its effectiveness for realistic rendering of subsurface scattering effects."

By Junyeong Ahn, Jaegul Choo
arXiv Computer Vision
Sep 18

GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

GS-PI introduces an optimization‑decoupled framework that transforms Gaussian Splatting (GS) assets into physically based rendering (PBR) compatible Gaussian assets. By treating PBR material generation as a geometry‑conditioned diffusion process on 3D point clouds, it achieves multi‑view consistency and avoids the pixel‑correspondence problems of 2D diffusion. The method employs a multi‑scale cross‑view conditioning mechanism—combining global semantic priors, photometric cues, and spatial view‑direction signals—to prevent specular highlights from baking into intrinsic colors, and then distills the predicted attributes back into a fully relightable PBR‑GS asset without requiring proxy meshes.

By Jieting Xu, Rengan Xie, Zijian Huang, Zehui Jin, Rui Wang, Yuchi Huo
arXiv Computer Vision
Sep 18

RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objects

The paper introduces Reflection-aware Gaussian Splatting (RGS), a physically-based deferred rendering framework that improves novel view synthesis for reflective objects. RGS leverages a powerful 3D foundation model to provide a strong geometric prior and employs cross-view shape consistency regularization to prevent surface collapse and reduce geometric hollows. Additionally, a reflection-aware densification strategy captures specular variations across views, resulting in higher-quality renderings of reflective objects.

By Xiaobiao Du, Yida Wang, Cheng Bi, Kun Zhan, Xin Yu
Hugging Face Trending Papers
Jul 23

Engine-Native Editable 3D World Reconstruction with Objects and Lighting

Editable 3D scene creation requires object instances and lights that can be inspected, moved, and imported into standard engines, yet existing single-image methods largely stop at room-scale geometry, baked/global illumination, or text-driven generation. We introduce Lumera (Light-aware Unified Engine-native Reconstruction and Assembly), a benchmark and reference pipeline for engine-native, light-aware 3D scene parsing from a single image.

Hugging Face Trending Papers
Oct 5

Casual Flash Lighting for Gaussian Splat Inverse Rendering

The paper introduces a method that combines casual indoor photographs taken with and without flash to recover geometry, materials, and lighting. By using flash residuals to constrain albedo and BRDF and static lighting to capture specular highlights, the approach employs a hash‑encoded MLP anchored to a 2DGS depth map for view‑consistent material decomposition. Experiments on synthetic and real scenes show improved diffuse color, albedo, roughness, and relighting performance, achieving a 4.17 dB PSNR gain over the best baseline.