arXiv Computer Vision

EvenSplat: Coupled 2D-3D Decomposition for Gaussian Splatting under Exposure and Illumination Variation

arXiv AI
Jul 1

Intrinsic decomposition and editing of 3D Gaussian splats

arXiv:2606. 31637v1 Announce Type: cross Abstract: Intrinsic decomposition which expresses image colors as the product of diffuse albedo and shading, possibly augmented with view-dependent residuals has a long history in image editing as it enables the modification of object colors and textures without altering lighting.

By Alexandre Lanvin, Jeffrey Hu, Simon Lucas, Adrien Bousseau, George Drettakis
Hugging Face Trending Papers
Oct 5

Casual Flash Lighting for Gaussian Splat Inverse Rendering

The paper introduces a method that combines casual indoor photographs taken with and without flash to recover geometry, materials, and lighting. By using flash residuals to constrain albedo and BRDF and static lighting to capture specular highlights, the approach employs a hash‑encoded MLP anchored to a 2DGS depth map for view‑consistent material decomposition. Experiments on synthetic and real scenes show improved diffuse color, albedo, roughness, and relighting performance, achieving a 4.17 dB PSNR gain over the best baseline.

arXiv Computer Vision
6d ago

RetinexGS: Retinex-Inspired Gaussian Splatting for Low-Light RAW Reconstruction

RetinexGS is a RAW-domain 3D Gaussian Splatting framework that improves low-light novel-view synthesis by combining Retinex-inspired appearance modeling with sensor-informed optimization. It factorizes each Gaussian’s color into a view-independent base color and a shared, position- and view-dependent modulation field, regularizing them separately to handle noisy observations. Using DNG noise metadata to weight the reconstruction loss and depth-guided initialization, RetinexGS outperforms LE3D and RawNeRF by 2.18 dB and 2.71 dB in mean sRGB PSNR across five scenes while enabling real-time rendering.

By Yulang Fei, Huaiyuan Weng, Chul Min Yeum
arXiv Computer Vision
Oct 28

GraftRay: Physically Based Mesh Insertion into Gaussian Splatting Scenes via Path Tracing

GraftRay is a method for inserting mesh objects into scenes reconstructed with 2D or 3D Gaussian splatting, ensuring physically consistent lighting and shadows. It recovers scene materials and normals using diffusion priors, models spatially‑extended emitters in closed form, and employs a hybrid renderer that path‑traces both Gaussians and meshes to produce view‑consistent shading, interreflections, and soft shadows. On the FIPT benchmark, GraftRay achieves state‑of‑the‑art rendering fidelity and shadow accuracy while remaining competitive in rendering efficiency.

By Jinxin Ai, Matthias Niessner
arXiv Computer Vision
Oct 12

Gaussian Splatting with Reflections Guided by What is Seen

The paper introduces a new framework that uses 2D Gaussian Splatting to capture view‑dependent specular effects, especially near‑field reflections, by directly leveraging observable environment information in input images. It combines a hybrid reflection appearance representation with view‑dependent specular modeling, and demonstrates improved rendering quality and geometric accuracy on public benchmarks and a newly curated near‑field reflection dataset.

By Yiming Liang, Tianyu Xiao, Hiroshi Ishikawa
arXiv Computer Vision
Oct 7

VolS-GS: Relightable Gaussian Splatting with Volumetric Subsurface Scattering

VolS-GS is a relightable Gaussian splatting framework that reconstructs objects from one-light-at-a-time captures and renders them under novel lighting and viewpoints. It addresses the difficulty of modeling non‑local effects such as subsurface scattering by using the spatial support of the Gaussian scene as the domain of a differentiable finite‑volume transport solver, allowing light to propagate through the object's interior. A small network predicts scattering and absorption coefficients for each Gaussian, and the solver redistributes incident light, while a shadow term and regularizer prevent learned shadow and specular terms from dominating the appearance. "whyItMatters":"The approach improves relighting quality on held‑out lights and views across three OLAT benchmarks, demonstrating its effectiveness for realistic rendering of subsurface scattering effects."

By Junyeong Ahn, Jaegul Choo
Hugging Face Trending Papers
Sep 10

Tri-DehazeGS: Scene--Medium Decoupled Gaussian Splatting with Transmittance-Aware Optimization

Tri-DehazeGS tackles the problem of reconstructing clean 3D scenes from hazy multi‑view images by decoupling the scene and the haze medium. It represents the scene with Gaussian primitives while modeling the haze as an independent view‑shared tri‑plane field, and composes hazy observations through a physical scattering model. The method introduces Medium‑Decoupled Transmittance Gradient Compensation (MD‑TGC) to balance gradients in low‑transmittance regions, leading to improved novel‑view reconstruction on real and synthetic haze benchmarks.

arXiv Computer Vision
Sep 18

GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

GS-PI introduces an optimization‑decoupled framework that transforms Gaussian Splatting (GS) assets into physically based rendering (PBR) compatible Gaussian assets. By treating PBR material generation as a geometry‑conditioned diffusion process on 3D point clouds, it achieves multi‑view consistency and avoids the pixel‑correspondence problems of 2D diffusion. The method employs a multi‑scale cross‑view conditioning mechanism—combining global semantic priors, photometric cues, and spatial view‑direction signals—to prevent specular highlights from baking into intrinsic colors, and then distills the predicted attributes back into a fully relightable PBR‑GS asset without requiring proxy meshes.

By Jieting Xu, Rengan Xie, Zijian Huang, Zehui Jin, Rui Wang, Yuchi Huo
arXiv Computer Vision
Sep 11

Tri-DehazeGS: Scene--Medium Decoupled Gaussian Splatting with Transmittance-Aware Optimization

Tri‑DehazeGS is a Gaussian Splatting framework that decouples clean scene reconstruction from atmospheric haze by representing the scene with Gaussian primitives and the haze medium with an independent view‑shared tri‑plane field. It uses a physical scattering model to compose hazy observations and introduces Medium‑Decoupled Transmittance Gradient Compensation (MD‑TGC) to re‑balance gradients in low‑transmittance regions without altering forward rendering. Experiments on real and synthetic haze benchmarks demonstrate that this approach improves clean novel‑view reconstruction.

By Kui Jiang, Yang Gu, Jiacheng Liu, Shiyu Liu, Youyu Chen, Hui Liu