arXiv Computer Vision By Zhongpai Gao, Benjamin Planche, Meng Zheng, Anwesa Choudhuri, Terrence Chen, Ziyan Wu

FactorSplat: Appearance-Controllable Gaussian Proxies for Medical Volume Rendering

Read the original on arXiv Computer Vision →

FactorSplat introduces a per-scene N‑dimensional Gaussian splatting proxy that allows region‑specific intensity‑to‑RGBA curves to be applied at inference, enabling appearance control in medical volume rendering. The method uses a shared functional encoder and low‑rank per‑Gaussian factors to learn residual appearance while keeping geometry and directional appearance shared across presets. Experiments on seven CT and MR scans show that FactorSplat outperforms region‑aware VEG in mean PSNR and changed‑region error across validation, interpolation, unseen composition, and out‑of‑distribution edits, achieving 1.10 to 1.52 dB PSNR gains and supporting fast TF switches at 524 FPS.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Jun 24

Render-FM: Feedforward Model for Real-time Photorealistic Volumetric Rendering

arXiv:2505. 17338v3 Announce Type: replace-cross Abstract: Photorealistic volumetric rendering of CT scans greatly benefits clinical workflows, yet neural approaches such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) require prohibitive per-scan optimization (hours for NeRF, about 30 minutes for 3DGS), making them impractical in clinical settings.

By Zhongpai Gao, Benjamin Planche, Meng Zheng, Anwesa Choudhuri, Van Nguyen Nguyen, Terrence Chen, Ziyan Wu
arXiv Computer Vision
Oct 5

XClipGS: Exact Half-Space Clipping for Medical Volume Gaussian Splatting

XClipGS introduces an exact half‑space clipping method for Gaussian‑splatting of medical volumes, enabling precise rendering of clipped anatomy without learned clipping parameters. The technique factorizes the ray integral into a 2D footprint and a conditional Gaussian CDF, remaining differentiable and efficient. Evaluated on eight CT and MRI datasets, XClipGS outperforms prior methods in PSNR, SSIM, and leakage while achieving over 650 FPS.

By Zhongpai Gao, Benjamin Planche, Meng Zheng, Anwesa Choudhuri, Chaoyi Zhou, Terrence Chen, Ziyan Wu
arXiv AI
Oct 5

DAGS: Disentangled Appearance-and-Geometry Steering of a Frozen Image DiT for Temporally Stabilized Generative Rendering

DAGS introduces a lightweight, attention‑free conditioning scheme that disentangles appearance and geometry for a frozen image diffusion transformer (DiT), enabling high‑fidelity, temporally stable renders with independent control. Two small convolutional encoders generate per‑frame conditioning features, which are injected as learned residuals into the image tokens, avoiding the quadratic cost of attention. Coupled with a recurrent lighting stabilizer and a training‑free temporal guidance term, DAGS transforms a per‑frame image model into a streaming renderer that outperforms real‑time denoisers and diffusion renderers in PSNR and temporal stability while requiring far less compute than path tracing.

By Karthik Mohan Kumar, Damian Andrysiak, Pedro Antonio Pena, Kunal Tyagi, Rama Harihara
arXiv Computer Vision
Oct 8

TileSkipper: Region-Adaptive Tile Pruning for 3D Gaussian Splatting

TileSkipper introduces a region‑adaptive tile pruning strategy for 3D Gaussian splatting rasterizers, assigning a static per‑Gaussian contribution cutoff policy that is calibrated on a frozen checkpoint. The method partitions Gaussians into 64 groups, uses a single‑byte policy per Gaussian, and requires no runtime updates or additional kernels. Across 13 benchmark scenes, TileSkipper achieves up to 1.238× speedups with negligible PSNR loss, and integrates with existing opacity‑aware bounds for further compiler‑only gains.

By Jingxing Li, Yongjae Lee, Deliang Fan, Abhay Kumar Yadav, Cheng Peng, Rama Chellappa