arXiv:2607.08016v3 Announce Type: replace Abstract: Video relighting requires balancing long-form temporal consistency with a physically grounded understanding of light transport, which depends on ac...
arXiv:2502. 07531v5 Announce Type: replace-cross Abstract: Controllable image-to-video (I2V) generation transforms a reference image into a coherent video guided by user-specified control signals.
arXiv:2601.01865v2 Announce Type: replace Abstract: With the growing demand for real-time video enhancement in live applications, existing methods often struggle to balance speed and effective exposu...
GSHeadRelight introduces a fast relighting method for 3D Gaussian head synthesis, addressing the need for photorealistic rendering, real‑time performance, and generalization to unseen subjects in portrait photography, VR, and AR. The approach uses a unified neural radiance transfer representation that linearly responds to incident light, relying only on in‑the‑wild images rather than expensive light stage data. It achieves state‑of‑the‑art relighting results while delivering a rendering speed 12× faster than prior 3D‑aware portrait relighting methods.
We present Generative Relightable Avatars (GRA), a person-specific method for photorealistic free-view rendering and environment-map relighting of full-body humans. We postulate that modeling fine-grained appearance details is inherently a one-to-many problem that can benefit from a generative formulation.
arXiv:2604. 23094v2 Announce Type: replace-cross Abstract: Portrait relighting is a low-level vision problem in which physically plausible illumination transfer, identity preservation, and compact real-time inference must be considered together.
JointLight introduces an asynchronous joint-modeling approach for human-centric video relighting, enabling fine-grained illumination control by jointly denoising RGB and irradiance frames during two-stage training. The method employs a domain matching strategy to bridge gaps between synthetic irradiance cues and real irradiance maps, and uses an asynchronous hijacked generation pipeline at inference. A newly created multi-illumination synthetic video dataset with paired irradiance maps supports training, and the model demonstrates strong generalization to real-world scenarios, outperforming prior methods in lighting fidelity and generative quality.
arXiv:2608.29925v1 Announce Type: new Abstract: Controllable image relighting is an important problem in image editing, and hand-drawn scribbles provide an intuitive interface for specifying the desi...
arXiv:2607. 22830v2 Announce Type: replace Abstract: In visual storytelling, human performances are central to creative intent and narrative meaning.
GLOW is a Global Illumination‑aware inverse rendering framework for indoor scenes captured with dynamic co‑located light and camera setups. It combines a neural implicit surface representation with a neural radiance cache to jointly optimize geometry and reflectance, while introducing a dynamic radiance cache and a surface‑angle‑weighted radiometric loss to handle near‑field motion, strong inter‑reflections, and specular highlights. Experiments demonstrate that GLOW significantly outperforms prior methods in estimating material reflectance under both natural and co‑located illumination.
RelightFormer is a feed‑forward generative Transformer that performs single‑ and multi‑view image relighting without explicit intrinsic property estimation. It incorporates a latent illumination module that injects target environment maps into spatial features via cross‑attention, and uses permutation‑invariant positional encodings to process unordered multi‑view inputs symmetrically. Trained on the large Laval Objaverse Dataset, the model achieves state‑of‑the‑art visual and photorealistic relighting quality, and demonstrates strong zero‑shot generalization across various relighting tasks.
Projector-camera (ProCams) systems achieve active scene perception and controllable appearance manipulation via structured illumination, serving as a core infrastructure for spatial augmented reality, projection mapping, and surface reflectance acquisition. Existing inverse-rendering methods for ProCams deliver high-fidelity results but rely on time-consuming per-scene optimization, while mainstream feed-forward 3D reconstruction models produce baked appearance that cannot adapt to spatially varying projector illumination.