arXiv Computer Vision

Sphinx: Efficiently Serving Novel View Synthesis using Regression-Guided Selective Refinement

Sphinx is a training‑free hybrid inference system for novel view synthesis that combines fast regression models with selective diffusion refinement. It first generates coarse views via regression, then applies diffusion only where needed to improve quality while reducing computation. An SLO‑aware scheduler dynamically allocates GPU resources, achieving up to 2.7× faster inference with less than 10% perceptual loss and up to 10× higher SLO attainment compared to FCFS scheduling.

Hugging Face Trending Papers
Aug 3

StreamSplat: Streaming Feed-Forward 3D Gaussian Splatting

Feed-forward 3D Gaussian Splatting enables efficient novel-view synthesis without per-scene optimization, but most existing methods assume a fixed set of context views and process them jointly. This limits their applicability to online scenarios where calibrated views arrive sequentially and the scene must be updated causally.

arXiv AI
Sep 28

Spackle: Completing Large View Single Image NVS with Adaptive Gaussians

Spackle is a lightweight residual learning framework designed to improve large-view single-image novel view synthesis (NVS) by mitigating capacity competition in hybrid decoupled systems that combine 3D Gaussian Splatting (3DGS) and diffusion models. It operates in three stages: predicting base 3DGS attributes, automatically identifying poorly reconstructed regions, and learning a residual 3DGS focused on those areas. During inference, Spackle merges the baseline and augmented Gaussians to produce high-fidelity novel views, achieving state‑of‑the‑art performance on large-view-deviation cases.

By Xuanzhi Liu, Yuhe Zhou, Xinyi Wu, Zhenyao Wu, Jinghao Chen, Ruize Han, Song Wang
arXiv Machine Learning
Sep 14

AnyView: Synthesizing Any Novel View in Dynamic Scenes

AnyView is a diffusion-based video generation framework designed for dynamic view synthesis, requiring minimal inductive biases or geometric assumptions. It trains a generalist spatiotemporal implicit representation using diverse data sources—monocular, multi-view static, and multi-view dynamic—to produce zero-shot novel videos from arbitrary camera locations and trajectories. The authors evaluate AnyView on standard benchmarks, introduce a new challenging benchmark called AnyViewBench for extreme dynamic view synthesis, and demonstrate that AnyView outperforms baselines in maintaining realistic, plausible, and spatiotemporally consistent videos across diverse real-world scenarios.

By Basile Van Hoorick, Dian Chen, Shun Iwase, Pavel Tokmakov, Muhammad Zubair Irshad, Igor Vasiljevic, Swati Gupta, Fangzhou Cheng, Sergey Zakharov, Vitor Campagnolo Guizilini
arXiv AI
6d ago

Turbo4DGen: Ultra-Fast Acceleration for 4D Generation

Turbo4DGen is an ultra‑fast acceleration framework designed for diffusion‑based multi‑view 4D content generation. It introduces a spatiotemporal cache that reuses intermediate attention across denoising steps, along with semantic‑aware attention pruning and an adaptive SCM chain bypass scheduler to cut redundant computations. Experiments on ObjaverseDy and Consistent4D show an average 9.7× speedup without quality loss, making it the first dedicated acceleration solution for 4D generation.

By Yuanbin Man, Ying Huang, Zhile Ren, Miao Yin
arXiv AI
Sep 10

From Splats to Silicon: Rethinking Computational Efficiency of 3DGS

arXiv:2609.06157v1 Announce Type: cross Abstract: 3D Gaussian splatting (3DGS) represents scenes with explicit primitives and supports real-time novel-view synthesis, yet its system efficiency varies...

By Minnan Pei, Qiwei Dong, Yihan Zhou, Gang Li, Yuchen Zhu, Wenju Zhao, Zhongtian Long, Siting Wang, Peisong Wang, Jian Cheng
arXiv Computer Vision
Oct 22

NeuralSRender: G-Buffer Guided Video Diffusion for Sim-to-Real Rendering

NeuralSRender is a sim‑to‑real video translation framework that improves the photorealism of synthetic driving videos while preserving geometric consistency. It builds on a pretrained video diffusion transformer and uses a lightweight projector to inject G‑buffer geometric and material priors, with LoRA for efficient adaptation. The two‑stage training first learns G‑buffer conditioning from synthetic data, then adapts to real‑world appearance, adding only 1.45 % parameter overhead and requiring 24 GB GPU memory. The authors also release GenReal, a large‑scale dataset of synthetic and real driving videos with G‑buffers, and show that training perception models on NeuralSRender‑translated videos boosts detection AP₅₀ on nuImages from 35.1 to 40.6 and segmentation mIoU on Cityscapes from 32.4 to 40.8.

By Yipeng Lu, Youqi Liao, Zhenyu Wang, Yuning Peng, Zhen Dong