arXiv AI
Sep 10

RelightFormer: Feed-forward Generative Transformer for Multiview Object Relighting

RelightFormer is a feed‑forward generative Transformer that performs single‑ and multi‑view image relighting without explicit intrinsic property estimation. It incorporates a latent illumination module that injects target environment maps into spatial features via cross‑attention, and uses permutation‑invariant positional encodings to process unordered multi‑view inputs symmetrically. Trained on the large Laval Objaverse Dataset, the model achieves state‑of‑the‑art visual and photorealistic relighting quality, and demonstrates strong zero‑shot generalization across various relighting tasks.

By Hejun Wang, Jinxi Li, Junwei Jiang, Shiwei Mao, Hu Cheng, Shouwang Huang, Bo Yang
arXiv Computer Vision
4d ago

GSHeadRelight: Fast Relightability for 3D Gaussian Head Synthesis

GSHeadRelight introduces a fast relighting method for 3D Gaussian head synthesis, addressing the need for photorealistic rendering, real‑time performance, and generalization to unseen subjects in portrait photography, VR, and AR. The approach uses a unified neural radiance transfer representation that linearly responds to incident light, relying only on in‑the‑wild images rather than expensive light stage data. It achieves state‑of‑the‑art relighting results while delivering a rendering speed 12× faster than prior 3D‑aware portrait relighting methods.

By Henglei Lv, Bailin Deng, Jianzhu Guo, Xiaoqiang Liu, Pengfei Wan, Di Zhang, Lin Gao