arXiv Machine Learning

Secure AI-Driven Super-Resolution for Real-Time Mixed Reality Applications

The paper presents a system for real‑time mixed reality that reduces bandwidth and encryption overhead by downsampling point cloud data at the server and partially encrypting it. The client decrypts the data and uses a machine‑learning super‑resolution model to reconstruct the full‑resolution point clouds. Experiments show a nearly linear decrease in bandwidth and latency, with the super‑resolution model achieving low reconstruction error and modest inference time.

arXiv Machine Learning
Sep 3

Learning-Based Reconstruction Attacks on Coordinate-Obfuscated Point Clouds

The paper investigates the security of a selective coordinate encryption scheme for point clouds used in volumetric video. By training PointNet and Random Forest models on partially encrypted data, the authors show that fully encrypting all X coordinates is difficult to reconstruct, whereas encrypting every second X coordinate allows accurate recovery of the hidden values. The study highlights that the encryption granularity critically determines the vulnerability of the scheme.

By Mohammad Waquas Usmani, Susmit Shannigrahi, Michael Zink
arXiv Computer Vision
Oct 16

ResStreamGS: Residual-Sensitive Dual-Stream Gaussian Splatting for Mobile Volumetric Video Streaming

ResStreamGS introduces a residual‑sensitive dual‑stream framework for mobile volumetric video streaming that distinguishes temporally stable Gaussians from residual‑sensitive ones. Stable Gaussians are transmitted once per Group of Pictures, while only the residual‑sensitive Gaussians are included in the frame‑wise video stream, reducing bandwidth usage. Experiments on complex full‑scene videos show a 7.51–8.35 dB PSNR improvement over a V³‑style baseline, a payload reduction of up to 56.5%, and real‑time performance of 30.883 FPS on a Qualcomm Snapdragon 778G.

By Haoran Liu, Di Wu, Wang Luo, Hengyuan Na, Miao Hu, Guocong Quan
arXiv Computer Vision
Aug 24

Cloak of Invisibility: Real-Time Privacy-Preserving Volumetric Video Streaming

arXiv:2608.11645v2 Announce Type: replace Abstract: Volumetric video streaming turns privacy into a 3D, multi-view problem. Unlike ordinary video, where sensitive content can often be redacted frame...

By Hossein Khalili (UCLA), Philip Do (UCLA), Alexander Vilesov (UCLA), Achuta Kadambi (UCLA), Kittipat Apicharttrisorn (Nokia Bell Labs), Nader Sehatbakhsh (UCLA)
arXiv Machine Learning
Jul 14

DynaFilter: Cloud-driven Dynamic Filtering for Satellite Edge Intelligence

arXiv:2607. 10098v1 Announce Type: cross Abstract: Modern satellite edge systems, including those performing remote sensing tasks such object detection and tracking, are characterized by severely limited bandwidth and intermittent connections, making continuous data transmission to the cloud impractical.

By Ziyang Zhang, Jie Liu, Luca Mottola
arXiv AI
Jul 24

RealVDeblur: One-Step Diffusion for Generalizable Real-World Video Deblurring

arXiv:2607. 20628v1 Announce Type: cross Abstract: Real-world video deblurring remains challenging due to diverse motion patterns, complex degradations, and the scarcity of realistic training data, yet robust restoration is critical for downstream pipelines such as mobile imaging and 3D reconstruction.

By Renbiao Jin, Mingxin Yang, Yutian Chen, Junhao Zhuang, Xin Cai, Mulin Yu, Linning Xu, Wenxian Yu, Danping Zou, Shi Guo, Tianfan Xue
arXiv Computer Vision
Sep 30

RelayVSR: Large-Small Model Collaboration for Efficient Real-World Video Super-Resolution

RelayVSR introduces a streaming video super‑resolution framework that combines a large generative model, which produces reference latents for sparse keyframes, with a lightweight Dual‑Memory Video Transformer that super‑resolves every frame using these references and low‑resolution input. The method employs Video‑Aware Reference Optimization (VARO), a reinforcement‑learning strategy that optimizes both system‑level video quality and reference‑level keyframe fidelity, outperforming direct joint training. On 1080p video, RelayVSR achieves 29.29 FPS with modest GPU memory usage, significantly faster and more efficient than the FlashVSR‑Tiny baseline.

By Xijun Wang, Xin Li, Zirui Lang, Suhang Yao, Haoran Li, Zhibo Chen
Hugging Face Trending Papers
Jun 8

SwiftVR: Real-Time One-Step Generative Video Restoration

Real-time video restoration (VR) for live streams requires high-resolution outputs under strict per-frame latency constraints. Existing one-step diffusion-based VR models remain difficult to deploy on consumer-grade GPUs due to two main bottlenecks: quadratic spatial attention at high resolutions and the latency-memory overhead of large video autoencoders.