arXiv Machine Learning

Scene-Consistent Illumination Transfer for Inserted Advertising Graphics

arXiv Computer Vision
Sep 24

GLOW: Global Illumination-Aware Inverse Rendering of Indoor Scenes Captured with Dynamic Co-Located Light & Camera

GLOW is a Global Illumination‑aware inverse rendering framework for indoor scenes captured with dynamic co‑located light and camera setups. It combines a neural implicit surface representation with a neural radiance cache to jointly optimize geometry and reflectance, while introducing a dynamic radiance cache and a surface‑angle‑weighted radiometric loss to handle near‑field motion, strong inter‑reflections, and specular highlights. Experiments demonstrate that GLOW significantly outperforms prior methods in estimating material reflectance under both natural and co‑located illumination.

By Jiaye Wu, Saeed Hadadan, Geng Lin, Peihan Tu, Auguste Gezalyan, Matthias Zwicker, David Jacobs, Roni Sengupta
Hugging Face Trending Papers
Jun 21

Generative Relightable Avatars

We present Generative Relightable Avatars (GRA), a person-specific method for photorealistic free-view rendering and environment-map relighting of full-body humans. We postulate that modeling fine-grained appearance details is inherently a one-to-many problem that can benefit from a generative formulation.

arXiv AI
Sep 10

RelightFormer: Feed-forward Generative Transformer for Multiview Object Relighting

RelightFormer is a feed‑forward generative Transformer that performs single‑ and multi‑view image relighting without explicit intrinsic property estimation. It incorporates a latent illumination module that injects target environment maps into spatial features via cross‑attention, and uses permutation‑invariant positional encodings to process unordered multi‑view inputs symmetrically. Trained on the large Laval Objaverse Dataset, the model achieves state‑of‑the‑art visual and photorealistic relighting quality, and demonstrates strong zero‑shot generalization across various relighting tasks.

By Hejun Wang, Jinxi Li, Junwei Jiang, Shiwei Mao, Hu Cheng, Shouwang Huang, Bo Yang
arXiv Computer Vision
Sep 17

Geometry-Driven Shadow Harmonisation for Composited Faces: A Multiplicative, Albedo-Preserving Relighting Pipeline

The paper introduces a geometry‑driven shadow harmonisation pipeline for composited faces that preserves albedo by applying a per‑pixel gain field derived from a rasterised 3D face proxy. The method estimates key‑light direction from host cues, computes surface normals and cast shadows, and applies a controlled, monotonic darkening operation that never alters chromaticity or identity. Experiments on analytic face heightfields show that the default parameters modify over half the face pixels while maintaining hue invariance and avoiding repainting the donor face.

By Vijesh KP
arXiv AI
Jul 1

Intrinsic decomposition and editing of 3D Gaussian splats

arXiv:2606. 31637v1 Announce Type: cross Abstract: Intrinsic decomposition which expresses image colors as the product of diffuse albedo and shading, possibly augmented with view-dependent residuals has a long history in image editing as it enables the modification of object colors and textures without altering lighting.

By Alexandre Lanvin, Jeffrey Hu, Simon Lucas, Adrien Bousseau, George Drettakis
arXiv Computer Vision
Sep 17

PureLight: Learning Complex Luminaires with Light Tracing

PureLight introduces a neural approach to estimate the appearance of complex luminaires that are difficult for traditional path tracing, such as small emitters surrounded by multiple specular layers. The method uses light tracing to build paths from emitters to exit surfaces and learns the probability density function of outgoing radiance with a large normalizing flow network, then distills this into a lightweight MLP for efficient inference. Additionally, a sampling network and a blending network are trained to compute direct illumination and composite the luminaire into arbitrary scenes, enabling low‑sample rendering of challenging luminaires.

By Pedro Figueiredo, Zixuan Li, Beibei Wang, Milo\v{s} Ha\v{s}an, Nima Khademi Kalantari
arXiv Computer Vision
Sep 18

GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

GS-PI introduces an optimization‑decoupled framework that transforms Gaussian Splatting (GS) assets into physically based rendering (PBR) compatible Gaussian assets. By treating PBR material generation as a geometry‑conditioned diffusion process on 3D point clouds, it achieves multi‑view consistency and avoids the pixel‑correspondence problems of 2D diffusion. The method employs a multi‑scale cross‑view conditioning mechanism—combining global semantic priors, photometric cues, and spatial view‑direction signals—to prevent specular highlights from baking into intrinsic colors, and then distills the predicted attributes back into a fully relightable PBR‑GS asset without requiring proxy meshes.

By Jieting Xu, Rengan Xie, Zijian Huang, Zehui Jin, Rui Wang, Yuchi Huo