arXiv Computer Vision

RRNet: Configurable Real-Time Video Enhancement with Arbitrary Local Lighting Variations

arXiv AI
Sep 10

RelightFormer: Feed-forward Generative Transformer for Multiview Object Relighting

RelightFormer is a feed‑forward generative Transformer that performs single‑ and multi‑view image relighting without explicit intrinsic property estimation. It incorporates a latent illumination module that injects target environment maps into spatial features via cross‑attention, and uses permutation‑invariant positional encodings to process unordered multi‑view inputs symmetrically. Trained on the large Laval Objaverse Dataset, the model achieves state‑of‑the‑art visual and photorealistic relighting quality, and demonstrates strong zero‑shot generalization across various relighting tasks.

By Hejun Wang, Jinxi Li, Junwei Jiang, Shiwei Mao, Hu Cheng, Shouwang Huang, Bo Yang
arXiv Computer Vision
4d ago

GSHeadRelight: Fast Relightability for 3D Gaussian Head Synthesis

GSHeadRelight introduces a fast relighting method for 3D Gaussian head synthesis, addressing the need for photorealistic rendering, real‑time performance, and generalization to unseen subjects in portrait photography, VR, and AR. The approach uses a unified neural radiance transfer representation that linearly responds to incident light, relying only on in‑the‑wild images rather than expensive light stage data. It achieves state‑of‑the‑art relighting results while delivering a rendering speed 12× faster than prior 3D‑aware portrait relighting methods.

By Henglei Lv, Bailin Deng, Jianzhu Guo, Xiaoqiang Liu, Pengfei Wan, Di Zhang, Lin Gao
arXiv Computer Vision
Sep 28

IDM-Net: A Lightweight Illumination-Decoupled Modulation Network for Low-Light Image Enhancement

IDM-Net is a lightweight Illumination-Decoupled Modulation Network designed for low-light image enhancement. It uses a dual-encoder architecture: a structure encoder extracts multi-scale appearance features from the RGB image, while a lightweight illumination encoder learns illumination priors from the decoupled luminance channel. An Illumination-Guided Modulation module injects these priors into the decoder via spatially adaptive affine modulation, and a Feature Refinement Block progressively suppresses artifacts and recovers fine details, achieving competitive performance on standard benchmarks with good balance between quality and efficiency.

By Cheng-Yen Hsiao, Jing-Ming Guo
Hugging Face Trending Papers
Jul 20

FF-ProCams: Feed-Forward Gaussian Splatting for Projector-Camera System

Projector-camera (ProCams) systems achieve active scene perception and controllable appearance manipulation via structured illumination, serving as a core infrastructure for spatial augmented reality, projection mapping, and surface reflectance acquisition. Existing inverse-rendering methods for ProCams deliver high-fidelity results but rely on time-consuming per-scene optimization, while mainstream feed-forward 3D reconstruction models produce baked appearance that cannot adapt to spatially varying projector illumination.

arXiv AI
Jun 30

InsertAnywhere: Geometrically Grounded and Optics-Aware Video Object Insertion

arXiv:2512. 17504v2 Announce Type: replace-cross Abstract: Recent advances in diffusion models have enabled impressive video editing capabilities, yet production-grade Video Object Insertion (VOI) remains challenging due to inadequate 4D scene understanding and a lack of proper optical interactions, such as shadows and reflections.

By Hoiyeong Jin, Hyojin Jang, Junha Hyung, Jeongho Kim, Kinam Kim, Dongjin Kim, Huijin Choi, Hyeonji Kim, Jaegul Choo