arXiv AI

RIDE-Splat: Reflection Removal for In-the-Wild Driving Environments

RIDE‑Splat is a new pipeline that removes windshield reflections from driving videos to produce clean 3D reconstructions using 3D Gaussian Splatting. It assigns world‑consistent transmission to the 3D scene and models the camera‑attached reflection as a shared signed RGB image, learning geometry and reflection in two passes before fitting a clean 3DGS model. The authors also release the RIDE‑Splat Dataset, the first benchmark for reflection removal in driving scenes, and demonstrate that RIDE‑Splat outperforms existing methods on nine aggregate metrics, improving PSNR by up to 3.59 dB and reducing LPIPS by up to 0.0876.

arXiv Computer Vision
Oct 9

PAM-ToD: Plug-and-Play Appearance Modeling for Cross-Time-of-Day 3D Gaussian Splatting

PAM-ToD is a lightweight plug‑in that adapts a pre‑trained 3D Gaussian Splatting road scene to a new time of day by learning color corrections while keeping the original 3DGS parameters fixed. It scales each Gaussian’s existing color to model illumination changes and adds a brightness term for effects such as street lamps, learning these corrections from a few anchor images without separately estimating albedo and illumination. The method includes a spatial regularization to avoid abrupt changes and is evaluated on the CARLA-ToD benchmark, achieving higher PSNR and lower LPIPS than baselines in both static and dynamic settings.

By Kota Shimomura, Sungho Moon, Tsubasa Hirakawa, Takayoshi Yamashita, Sunghoon Im, Hironobu Fujiyoshi
arXiv AI
Oct 19

DriveWorld3D Evidence Constrained 3D World Modeling and Generative Simulation for Real-World Autonomous Driving

DriveWorld3D is a framework that integrates temporal video learning, multi‑sensor measurement constraints, and offline generative simulation to build a unified 3D world model for autonomous driving. Its online component tracks road surfaces, volumetric occupancy, dynamic entities, and road relations while explicitly managing physical occupancy, observability, and evidence provenance. The offline component reconstructs scenes with neural radiance fields or 3D Gaussian Splatting and expands rare conditions using generative models, but limits generated content from being used as geometric ground truth.

By Wei Wang (Robostreet research team Cambridge, MA, USA), Yiru Veronika Wang (Robostreet research team Cambridge, MA, USA), Yihan Wang (Robostreet research team Cambridge, MA, USA), Zihao Li (Robostreet research team Cambridge, MA, USA), Xiaohui Liang (Robostreet research team Cambridge, MA, USA)
Hugging Face Trending Papers
Jul 28

PanoLess: Environment Reconstruction from Partial Reflective Views

Reflections from shiny objects and glass facades naturally extend the field of view of a camera, capturing the surrounding environment without the need to pan the camera or acquire a full panorama. We propose PanoLess, a Gaussian-splat-based framework that reconstructs the surrounding environment as a distant illumination map from images captured on only one side of a reflective surface.

arXiv Computer Vision
Aug 24

GS-Net: Heterogeneous Vehicle Data Reuse via Generalizable Plug-and-Play 3DGS Module

GS‑Net is a lightweight plug‑and‑play module that expands sparse Structure‑from‑Motion point clouds into dense Gaussian primitives, enabling cross‑sensor view synthesis for autonomous driving. It learns a generalizable initialization for 3D Gaussian Splatting, improving rendering quality for both interpolated and extrapolated camera viewpoints. The authors introduce CARLA‑NVS, a benchmark with 12 uniformly spaced cameras, and show that GS‑Net outperforms standard 3DGS by 2.08 dB PSNR on interpolated views and 1.86 dB on extrapolated views while being 50× faster to initialize.

By Yichen Zhang, Zihan Wang, Jiali Han, Peilin Li, Jiaxun Zhang, Jianqiang Wang, Lei He, Keqiang Li
arXiv Computer Vision
Sep 30

AESplat: Advancing Pose-Free Feed-Forward 3D Gaussian Splatting via Decoupled Appearance Modeling

AESplat is a new pose‑free feed‑forward 3D Gaussian Splatting framework that improves rendering quality by decoupling view‑independent and view‑dependent appearance modeling. It directly extracts the base view‑independent appearance from input images and predicts higher‑order spherical harmonic coefficients with a shallow MLP that incorporates 3D‑aware inductive biases. Experiments on several datasets show AESplat outperforms state‑of‑the‑art methods, achieving up to 0.8 dB higher PSNR than NAS3R and 1.1 dB over DepthSplat on RealEstate10K.

By Shiwei Ren, Zhiang Liu, Yongchun Fang, Hongwei Chen
arXiv Computer Vision
Sep 11

Tri-DehazeGS: Scene--Medium Decoupled Gaussian Splatting with Transmittance-Aware Optimization

Tri‑DehazeGS is a Gaussian Splatting framework that decouples clean scene reconstruction from atmospheric haze by representing the scene with Gaussian primitives and the haze medium with an independent view‑shared tri‑plane field. It uses a physical scattering model to compose hazy observations and introduces Medium‑Decoupled Transmittance Gradient Compensation (MD‑TGC) to re‑balance gradients in low‑transmittance regions without altering forward rendering. Experiments on real and synthetic haze benchmarks demonstrate that this approach improves clean novel‑view reconstruction.

By Kui Jiang, Yang Gu, Jiacheng Liu, Shiyu Liu, Youyu Chen, Hui Liu