arXiv Computer Vision By Jieting Xu, Rengan Xie, Zijian Huang, Zehui Jin, Rui Wang, Yuchi Huo

GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

Read the original on arXiv Computer Vision →

GS-PI introduces an optimization‑decoupled framework that transforms Gaussian Splatting (GS) assets into physically based rendering (PBR) compatible Gaussian assets. By treating PBR material generation as a geometry‑conditioned diffusion process on 3D point clouds, it achieves multi‑view consistency and avoids the pixel‑correspondence problems of 2D diffusion. The method employs a multi‑scale cross‑view conditioning mechanism—combining global semantic priors, photometric cues, and spatial view‑direction signals—to prevent specular highlights from baking into intrinsic colors, and then distills the predicted attributes back into a fully relightable PBR‑GS asset without requiring proxy meshes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
1d ago

Integrating Learned Priors through Prior-Space Reparameterization for Physically Based Inverse Rendering

The paper introduces a prior-guided material reparameterization for physically based inverse rendering, leveraging learned material predictions to restrict the optimization space without altering the photometric objective. By fusing multi-view predictions onto a mesh and constructing a permutohedral lattice in prior feature space, surface points with similar predictions share material variables, which are jointly optimized with geometry and illumination. Experiments on synthetic benchmarks and Stanford-ORB show improved material decomposition and relighting, with PSNR gains of 1.5–2.5 dB over strong baselines and a faster optimization schedule that maintains high relighting quality.

By Hun Hwangbo, Minjun Park, Yongsung Kim, Wooseok Song, Jungmin Ko, Junghyun Hwang, Sungroh Yoon