arXiv Machine Learning

RenderFormer++: Scalable and Physics-Informed Feed-Forward Neural Rendering

arXiv:2606. 30380v2 Announce Type: replace-cross Abstract: We present RenderFormer++, a scalable and physics-informed feed-forward neural rendering framework for global illumination in mesh scenes.

arXiv AI
Sep 10

RelightFormer: Feed-forward Generative Transformer for Multiview Object Relighting

RelightFormer is a feed‑forward generative Transformer that performs single‑ and multi‑view image relighting without explicit intrinsic property estimation. It incorporates a latent illumination module that injects target environment maps into spatial features via cross‑attention, and uses permutation‑invariant positional encodings to process unordered multi‑view inputs symmetrically. Trained on the large Laval Objaverse Dataset, the model achieves state‑of‑the‑art visual and photorealistic relighting quality, and demonstrates strong zero‑shot generalization across various relighting tasks.

By Hejun Wang, Jinxi Li, Junwei Jiang, Shiwei Mao, Hu Cheng, Shouwang Huang, Bo Yang
Hugging Face Trending Papers
Aug 6

Floating Radiance Networks

Recent advances in neural scene representations enable photorealistic novel-view synthesis, yet most methods remain tightly coupled to a single rendering paradigm, limiting their versatility and integration with conventional graphics workflows. We introduce Floating Radiance Networks (FlaRe), a neural scene representation combining explicit ray-traceable geometry with continuous neural radiance functions.

arXiv Machine Learning
5d ago

DiffusionShadow: Diffusion-based Shadow Caching for Neural Volume Rendering

DiffusionShadow introduces a diffusion-based shadow caching framework for neural volume rendering, compressing many pre‑computed shadow INRs into a single diffusion model conditioned on lighting direction. The method encodes shadow coefficient volumes as shadow INRs, trains the diffusion model to predict shadow INR weights at inference, and integrates directly with standard INR renderers without extra runtime sampling. Experiments demonstrate faster rendering than traditional approaches while avoiding the large storage overhead of independent INRs, producing shadows that closely match reference results.

By Kai-Chen Tung, Qi Wu, David Bauer, Mengjiao Han, Silvio Rizzi, Kwan-Liu Ma
arXiv AI
Sep 21

Physically Based Rendering in the Latent Space

The paper introduces a method that applies physically based rendering (PBR) within the latent space of variational autoencoders used in image diffusion models. By modifying the rendering equation and using a differentiable renderer, the authors can generate latent maps that guide content creation with physically accurate lighting. The approach is trained on a single rendered image and then shown to generalize to changes in scene geometry, lighting, and camera viewpoint.

By Vuk Radovanovic, Vishesh Gupta, Adrien Gruson, Binh-Son Hua