arXiv Computer Vision

Albedo Estimation via Latent Bridge Matching

arXiv Computer Vision
Sep 11

Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Models

The paper introduces a benchmark called Shedding Light to evaluate how well generative image models understand and reproduce lighting. The benchmark tests models by asking them to inpaint a simple object, called a light probe, into real photographs and then compares the generated probe to the ground truth to assess lighting direction, colour, and radiance. The authors provide a scalable protocol and open-source code and data for systematic assessment of photometric accuracy in future models.

By Justine Giroux, Jack Oliver Hilliard, Yannick Hold-Geoffroy, Javier Vazquez-Corral, Jean-Fran\c{c}ois Lalonde
arXiv Computer Vision
6d ago

Integrating Learned Priors through Prior-Space Reparameterization for Physically Based Inverse Rendering

The paper introduces a prior-guided material reparameterization for physically based inverse rendering, leveraging learned material predictions to restrict the optimization space without altering the photometric objective. By fusing multi-view predictions onto a mesh and constructing a permutohedral lattice in prior feature space, surface points with similar predictions share material variables, which are jointly optimized with geometry and illumination. Experiments on synthetic benchmarks and Stanford-ORB show improved material decomposition and relighting, with PSNR gains of 1.5–2.5 dB over strong baselines and a faster optimization schedule that maintains high relighting quality.

By Hun Hwangbo, Minjun Park, Yongsung Kim, Wooseok Song, Jungmin Ko, Junghyun Hwang, Sungroh Yoon
Hugging Face Trending Papers
3d ago

Real-Time Volumetric Light Transport Inference without a Path

The paper introduces a real‑time technique for reconstructing fully integrated pixel radiance in volumetric media under both direct and ambient illumination. It bypasses expensive path‑traced radiance estimates by inferring the final light‑transport solution from compact scene features and statistics, using an attention‑augmented image‑to‑image network. The method achieves high reconstruction accuracy in challenging volumetric cloud scenarios while maintaining stable computational cost regardless of camera zoom or volume density.

arXiv Computer Vision
Oct 26

Do Image Editing Models Understand Lighting?

arXiv:2606.26738v3 Announce Type: replace Abstract: While recent advancements in generative image editing models have achieved stunning visual fidelity, it remains an open question whether these syst...

By Tim K\"uchler, Johann-Friedrich Feiden, Matthias Nie{\ss}ner, Carsten Rother
arXiv AI
Jul 1

Intrinsic decomposition and editing of 3D Gaussian splats

arXiv:2606. 31637v1 Announce Type: cross Abstract: Intrinsic decomposition which expresses image colors as the product of diffuse albedo and shading, possibly augmented with view-dependent residuals has a long history in image editing as it enables the modification of object colors and textures without altering lighting.

By Alexandre Lanvin, Jeffrey Hu, Simon Lucas, Adrien Bousseau, George Drettakis
arXiv Computer Vision
Oct 9

PAM-ToD: Plug-and-Play Appearance Modeling for Cross-Time-of-Day 3D Gaussian Splatting

PAM-ToD is a lightweight plug‑in that adapts a pre‑trained 3D Gaussian Splatting road scene to a new time of day by learning color corrections while keeping the original 3DGS parameters fixed. It scales each Gaussian’s existing color to model illumination changes and adds a brightness term for effects such as street lamps, learning these corrections from a few anchor images without separately estimating albedo and illumination. The method includes a spatial regularization to avoid abrupt changes and is evaluated on the CARLA-ToD benchmark, achieving higher PSNR and lower LPIPS than baselines in both static and dynamic settings.

By Kota Shimomura, Sungho Moon, Tsubasa Hirakawa, Takayoshi Yamashita, Sunghoon Im, Hironobu Fujiyoshi