arXiv Computer Vision

HELIOS: From midnight to noon, continuous outdoor urban scene relighting

arXiv Computer Vision
Oct 9

PAM-ToD: Plug-and-Play Appearance Modeling for Cross-Time-of-Day 3D Gaussian Splatting

PAM-ToD is a lightweight plug‑in that adapts a pre‑trained 3D Gaussian Splatting road scene to a new time of day by learning color corrections while keeping the original 3DGS parameters fixed. It scales each Gaussian’s existing color to model illumination changes and adds a brightness term for effects such as street lamps, learning these corrections from a few anchor images without separately estimating albedo and illumination. The method includes a spatial regularization to avoid abrupt changes and is evaluated on the CARLA-ToD benchmark, achieving higher PSNR and lower LPIPS than baselines in both static and dynamic settings.

By Kota Shimomura, Sungho Moon, Tsubasa Hirakawa, Takayoshi Yamashita, Sunghoon Im, Hironobu Fujiyoshi
arXiv Computer Vision
2d ago

Do Image Editing Models Understand Lighting?

arXiv:2606.26738v3 Announce Type: replace Abstract: While recent advancements in generative image editing models have achieved stunning visual fidelity, it remains an open question whether these syst...

By Tim K\"uchler, Johann-Friedrich Feiden, Matthias Nie{\ss}ner, Carsten Rother
arXiv Computer Vision
6d ago

JointLight: Human-Centric Video Relighting with Asynchronous RGB-Irradiance Joint Modeling

JointLight introduces an asynchronous joint-modeling approach for human-centric video relighting, enabling fine-grained illumination control by jointly denoising RGB and irradiance frames during two-stage training. The method employs a domain matching strategy to bridge gaps between synthetic irradiance cues and real irradiance maps, and uses an asynchronous hijacked generation pipeline at inference. A newly created multi-illumination synthetic video dataset with paired irradiance maps supports training, and the model demonstrates strong generalization to real-world scenarios, outperforming prior methods in lighting fidelity and generative quality.

By Henglei Lv, Bailin Deng, Xiaoqiang Liu, Yichen Wang, Haoxian Zhang, Pengfei Wan, Lin Gao
arXiv Computer Vision
Sep 10

Albedo Estimation via Latent Bridge Matching

arXiv:2609.09884v1 Announce Type: new Abstract: Recent advances in Intrinsic Image Decomposition (IID) have increasingly relied on generative models. However, progress remains limited by three key ch...

By Carme Corbi, David Serrano-Lozano, Javier Vazquez-Corral, Maria Vanrell
arXiv AI
Sep 10

WildRelight: A Real-World Benchmark and Physics-Guided Adaptation for Single-Image Relighting

WildRelight is the first in-the-wild dataset designed to evaluate single-image relighting models, featuring high-resolution outdoor scenes captured under strictly aligned, temporally varying natural illuminations paired with high-dynamic-range environment maps. The benchmark demonstrates that state-of-the-art models trained on synthetic data suffer severe domain shifts when applied to real-world imagery. Leveraging the dataset’s temporal structure, the authors introduce a physics-guided inference framework combining Diffusion Posterior Sampling with Temporal Sampling-Aware Test-Time Adaptation, enabling synthetic models to self-supervise and align with real-world statistics on-the-fly.

By Lezhong Wang, Mehmet Onurcan Kaya, Siavash Bigdeli, Jeppe Revall Frisvad
arXiv Computer Vision
Sep 24

GLOW: Global Illumination-Aware Inverse Rendering of Indoor Scenes Captured with Dynamic Co-Located Light & Camera

GLOW is a Global Illumination‑aware inverse rendering framework for indoor scenes captured with dynamic co‑located light and camera setups. It combines a neural implicit surface representation with a neural radiance cache to jointly optimize geometry and reflectance, while introducing a dynamic radiance cache and a surface‑angle‑weighted radiometric loss to handle near‑field motion, strong inter‑reflections, and specular highlights. Experiments demonstrate that GLOW significantly outperforms prior methods in estimating material reflectance under both natural and co‑located illumination.

By Jiaye Wu, Saeed Hadadan, Geng Lin, Peihan Tu, Auguste Gezalyan, Matthias Zwicker, David Jacobs, Roni Sengupta