arXiv AI By Vuk Radovanovic, Vishesh Gupta, Adrien Gruson, Binh-Son Hua

Physically Based Rendering in the Latent Space

Read the original on arXiv AI →

The paper introduces a method that applies physically based rendering (PBR) within the latent space of variational autoencoders used in image diffusion models. By modifying the rendering equation and using a differentiable renderer, the authors can generate latent maps that guide content creation with physically accurate lighting. The approach is trained on a single rendered image and then shown to generalize to changes in scene geometry, lighting, and camera viewpoint.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 19

RaPD: Resolution-Agnostic Pixel Diffusion via Semantics-Enriched Implicit Representations

RaPD (Resolution‑agnostic Pixel Diffusion) introduces a continuous Neural Image Field (NIF) latent space for diffusion, enabling resolution‑free generation. It incorporates Semantic Representation Guidance to make latent learning generation‑aware and a Coordinate‑Queried Attention Renderer for scale‑aware, coordinate‑conditioned rendering. A single denoised latent can be rendered at any resolution by adjusting query coordinates, keeping diffusion cost constant while improving generation quality and scalability.

By Yanhao Ge, Shanyan Guan, Weihao Wang, Ying Tai, Mingyu You