arXiv Computer Vision

FactorSplat: Appearance-Controllable Gaussian Proxies for Medical Volume Rendering

FactorSplat introduces a per-scene N‑dimensional Gaussian splatting proxy that allows region‑specific intensity‑to‑RGBA curves to be applied at inference, enabling appearance control in medical volume rendering. The method uses a shared functional encoder and low‑rank per‑Gaussian factors to learn residual appearance while keeping geometry and directional appearance shared across presets. Experiments on seven CT and MR scans show that FactorSplat outperforms region‑aware VEG in mean PSNR and changed‑region error across validation, interpolation, unseen composition, and out‑of‑distribution edits, achieving 1.10 to 1.52 dB PSNR gains and supporting fast TF switches at 524 FPS.

arXiv AI
Jun 24

Render-FM: Feedforward Model for Real-time Photorealistic Volumetric Rendering

arXiv:2505. 17338v3 Announce Type: replace-cross Abstract: Photorealistic volumetric rendering of CT scans greatly benefits clinical workflows, yet neural approaches such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) require prohibitive per-scan optimization (hours for NeRF, about 30 minutes for 3DGS), making them impractical in clinical settings.

By Zhongpai Gao, Benjamin Planche, Meng Zheng, Anwesa Choudhuri, Van Nguyen Nguyen, Terrence Chen, Ziyan Wu
arXiv Computer Vision
Oct 5

XClipGS: Exact Half-Space Clipping for Medical Volume Gaussian Splatting

XClipGS introduces an exact half‑space clipping method for Gaussian‑splatting of medical volumes, enabling precise rendering of clipped anatomy without learned clipping parameters. The technique factorizes the ray integral into a 2D footprint and a conditional Gaussian CDF, remaining differentiable and efficient. Evaluated on eight CT and MRI datasets, XClipGS outperforms prior methods in PSNR, SSIM, and leakage while achieving over 650 FPS.

By Zhongpai Gao, Benjamin Planche, Meng Zheng, Anwesa Choudhuri, Chaoyi Zhou, Terrence Chen, Ziyan Wu
arXiv AI
Oct 5

DAGS: Disentangled Appearance-and-Geometry Steering of a Frozen Image DiT for Temporally Stabilized Generative Rendering

DAGS introduces a lightweight, attention‑free conditioning scheme that disentangles appearance and geometry for a frozen image diffusion transformer (DiT), enabling high‑fidelity, temporally stable renders with independent control. Two small convolutional encoders generate per‑frame conditioning features, which are injected as learned residuals into the image tokens, avoiding the quadratic cost of attention. Coupled with a recurrent lighting stabilizer and a training‑free temporal guidance term, DAGS transforms a per‑frame image model into a streaming renderer that outperforms real‑time denoisers and diffusion renderers in PSNR and temporal stability while requiring far less compute than path tracing.

By Karthik Mohan Kumar, Damian Andrysiak, Pedro Antonio Pena, Kunal Tyagi, Rama Harihara
arXiv Computer Vision
Oct 8

TileSkipper: Region-Adaptive Tile Pruning for 3D Gaussian Splatting

TileSkipper introduces a region‑adaptive tile pruning strategy for 3D Gaussian splatting rasterizers, assigning a static per‑Gaussian contribution cutoff policy that is calibrated on a frozen checkpoint. The method partitions Gaussians into 64 groups, uses a single‑byte policy per Gaussian, and requires no runtime updates or additional kernels. Across 13 benchmark scenes, TileSkipper achieves up to 1.238× speedups with negligible PSNR loss, and integrates with existing opacity‑aware bounds for further compiler‑only gains.

By Jingxing Li, Yongjae Lee, Deliang Fan, Abhay Kumar Yadav, Cheng Peng, Rama Chellappa
arXiv Computer Vision
Oct 7

VolS-GS: Relightable Gaussian Splatting with Volumetric Subsurface Scattering

VolS-GS is a relightable Gaussian splatting framework that reconstructs objects from one-light-at-a-time captures and renders them under novel lighting and viewpoints. It addresses the difficulty of modeling non‑local effects such as subsurface scattering by using the spatial support of the Gaussian scene as the domain of a differentiable finite‑volume transport solver, allowing light to propagate through the object's interior. A small network predicts scattering and absorption coefficients for each Gaussian, and the solver redistributes incident light, while a shadow term and regularizer prevent learned shadow and specular terms from dominating the appearance. "whyItMatters":"The approach improves relighting quality on held‑out lights and views across three OLAT benchmarks, demonstrating its effectiveness for realistic rendering of subsurface scattering effects."

By Junyeong Ahn, Jaegul Choo
arXiv Computer Vision
Aug 28

ReSplat: Learning Recurrent Gaussian Splatting

ReSplat introduces a recurrent Gaussian splatting model that iteratively refines 3D Gaussians using the rendering error as a feedback signal, avoiding explicit gradient computation. The method starts from a compact reconstruction in a subsampled space, producing far fewer Gaussians than prior per‑pixel models, which reduces computational cost. Experiments on multiple datasets, view counts, and resolutions show state‑of‑the‑art performance with faster rendering speeds.

By Haofei Xu, Daniel Barath, Andreas Geiger, Marc Pollefeys
arXiv Computer Vision
Sep 30

EndoPrior-GS: Dynamic Endoscopic Reconstruction with a Joint Texture Prior

EndoPrior-GS is a new pipeline for dynamic endoscopic reconstruction that combines frame-extracted vision heuristics with depth maps. It creates a joint texture prior using a tool-filtered tissue mask, a non-specular photometric filter, and anatomical salience, which guides primitive initialization and density control. Experiments on EndoNeRF and SCARED datasets show that EndoPrior-GS reduces Flow Error by 27.7% and 25.8% compared to representative methods while maintaining real-time rendering speed and competitive quality.

By Jiaqi Huang, Shidong Wang, Tong Xin, Kabita Adhikari
arXiv AI
Aug 11

Resolution Meets Reduction: Efficient Visual Context for 3D Radiology Report Generation

arXiv:2608. 08713v1 Announce Type: cross Abstract: Vision-language models offer a promising path toward automating radiology report generation, but applying them to full 3D CT volumes poses substantial computational challenges.

By Jonathan Suprijadi, Raphael Stock, Moritz Langenberg, David Zimmerer, Kim-Celine Kahl, Stefan Denner, Yannick Kirchhoff, Karol Gotkowski, Maximilian Rokuss, Jeremias Traub, Tassilo Wald, Constantin Ulrich, Klaus Maier-Hein