arXiv Computer Vision

ThermoSplat: Cross-Modal 3D Gaussian Splatting with Feature Modulation and Geometry Decoupling

arXiv Computer Vision
Sep 18

GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

GS-PI introduces an optimization‑decoupled framework that transforms Gaussian Splatting (GS) assets into physically based rendering (PBR) compatible Gaussian assets. By treating PBR material generation as a geometry‑conditioned diffusion process on 3D point clouds, it achieves multi‑view consistency and avoids the pixel‑correspondence problems of 2D diffusion. The method employs a multi‑scale cross‑view conditioning mechanism—combining global semantic priors, photometric cues, and spatial view‑direction signals—to prevent specular highlights from baking into intrinsic colors, and then distills the predicted attributes back into a fully relightable PBR‑GS asset without requiring proxy meshes.

By Jieting Xu, Rengan Xie, Zijian Huang, Zehui Jin, Rui Wang, Yuchi Huo
arXiv Computer Vision
Sep 14

RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradation

RA‑SOD is a new RGB‑Thermal salient object detection framework that explicitly models the reliability of each modality. It introduces a reliability‑conditioned representation, an uncertainty‑guided dual‑stream refinement, and a pixel‑wise modality competition mechanism to adaptively compensate degraded features and suppress unreliable evidence. Experiments on four benchmarks show that RA‑SOD achieves state‑of‑the‑art performance and remains robust under severe modality degradation.

By Hongbo Gao, Zhengyu Li, Xueru Nie, Dihao Zhu, Lijun Zhao, Yunke Wang, Chang Xu
arXiv Computer Vision
4d ago

VesperMUSE: Multi-Modal Fusion Vision Transformer for Image Semantic Segmentation Under Diverse Light Conditions

VesperMUSE is a multi‑modal vision transformer that enhances image semantic segmentation under varied lighting by combining physics‑informed low‑light adaptation, thermal‑guided low‑light image enhancement, and surface normal maps. The framework fuses RGB, thermal, and normal features through a modality‑agnostic self‑attention mechanism, enabling robust segmentation without architectural changes for different sensor setups. Extensive tests show that VesperMUSE recovers missing visual cues and achieves state‑of‑the‑art performance in extreme, unstructured environments.

By Raul Balmez