arXiv Computer Vision

ATGS: Anchored Temporal Gaussian Splatting for Long Volumetric Video Representation

arXiv Computer Vision
3d ago

ResStreamGS: Residual-Sensitive Dual-Stream Gaussian Splatting for Mobile Volumetric Video Streaming

ResStreamGS introduces a residual‑sensitive dual‑stream framework for mobile volumetric video streaming that distinguishes temporally stable Gaussians from residual‑sensitive ones. Stable Gaussians are transmitted once per Group of Pictures, while only the residual‑sensitive Gaussians are included in the frame‑wise video stream, reducing bandwidth usage. Experiments on complex full‑scene videos show a 7.51–8.35 dB PSNR improvement over a V³‑style baseline, a payload reduction of up to 56.5%, and real‑time performance of 30.883 FPS on a Qualcomm Snapdragon 778G.

By Haoran Liu, Di Wu, Wang Luo, Hengyuan Na, Miao Hu, Guocong Quan
arXiv Computer Vision
3d ago

Dusting the Phantom: Gaussian Allocation for Fading Dynamic Content

The paper introduces two new strategies—Seed Injection and Temporal Biased Relocation—to improve Gaussian-based volumetric video reconstruction in highly dynamic scenes. Seed Injection detects under‑reconstructed regions by monitoring temporal appearance changes and reconstruction errors, then initializes new Gaussians at plausible 3D locations using multi‑view data, independent of existing Gaussian positions. Temporal Biased Relocation guides the placement of relocated Gaussians using time‑resolved optimization signals, all while keeping the Gaussian budget fixed. Experiments on multiple dynamic‑scene datasets show that these methods recover small, fast‑moving objects and fine appearance details that previous allocation strategies missed.

By Minhyeok Roh, Minseo Lee, Jun Young Jeong, Byeonghyeon Lee, Lucas Yunkyu Lee, Jaesik Park, Eunbyung Park
arXiv Computer Vision
3d ago

Anchor3DGS: Feed-Forward 3D Gaussian Splatting with Compact Anchor-Based Representation

Anchor3DGS introduces a pose‑free, feed‑forward 3D Gaussian Splatting framework that replaces pixel‑aligned Gaussian prediction with a compact anchor‑based representation. By placing 3D anchors guided by information entropy, the method concentrates primitives in visually complex regions while ensuring broad spatial coverage, and each anchor aggregates multi‑view features to generate local Gaussians. A lightweight feature enhancement module refines the coarse RGB output, resulting in state‑of‑the‑art novel view synthesis quality with an order of magnitude fewer Gaussian primitives than prior approaches.

By Sheng Ye, Jiangke Lin, Fudong Wang, Yi Yuan, Zhen-Hui Dong, Yong-Jin Liu
arXiv Computer Vision
Aug 27

Forge4D: Feed-Forward 4D Human Reconstruction and Interpolation from Uncalibrated Sparse-view Videos

Forge4D is a feed‑forward model that reconstructs temporally aligned 4D human representations from uncalibrated sparse‑view videos, enabling both novel view and novel time synthesis. It achieves this by jointly streaming 3D Gaussian reconstruction with dense motion prediction, using learnable state tokens for temporal consistency and a self‑supervised retargeting loss for motion prediction. Extensive experiments confirm its effectiveness on in‑domain and out‑of‑domain datasets.

By Yingdong Hu, Yisheng He, Jinnan Chen, Weihao Yuan, Kejie Qiu, Zehong Lin, Siyu Zhu, Zilong Dong, Steven Hoi, Jun Zhang