arXiv Computer Vision

Cloak of Invisibility: Real-Time Privacy-Preserving Volumetric Video Streaming

arXiv Computer Vision
2d ago

PrinGS: Privacy Preservation in Gaussian Splatting

PrinGS introduces a privacy‑preserving framework for 3D Gaussian Splatting, enabling post‑training anonymization of sensitive content such as faces, license plates, documents, and computer screens. By localizing and directly anonymizing regions in the 3D representation, the method removes sensitive information from all rendered novel views while maintaining scene geometry and visual fidelity, achieving this in under one second. The approach also offers a privacy‑by‑design training strategy that prevents sensitive data from being encoded during optimization, yielding splats with low face similarity and unreadable text.

By Gaurav Behera, Abhinav Raundhal, Archisha Panda, Saumya Balina, Gargi Shroff, Ponnurangam Kumaraguru
arXiv AI
4d ago

Guided Zero-Shot Anomaly Explanation for Anonymized Crowd Video Monitoring: Context, Categorization, and Spatial Localization

The paper introduces XAVAD, a unified approach for explainable anomaly detection in anonymized crowd video monitoring. It combines zero‑shot anonymization, anomaly type categorization, spatial localization, and scene context description using multimodal CLIP embeddings, LLM‑assisted prompting, and a prompt‑guided patching autofocus mechanism. Experiments on public CCTV datasets show XAVAD outperforms state‑of‑the‑art methods and offers insights into privacy‑explainability trade‑offs.

By Mulugeta Weldezgina Asres, Lei Jiao, Christian Walter Omlin
arXiv Computer Vision
Sep 24

Privacy-Preserving Semantic Segmentation from High-Resolution Depth and Ultra-Low-Resolution RGB

The paper introduces a privacy‑preserving approach for semantic segmentation that fuses high‑resolution depth with ultra‑low‑resolution RGB images. A joint 2D framework uses depth to guide RGB reconstruction and RGB‑D segmentation, while an end‑to‑end 2D‑to‑3D pipeline consolidates 2D features for 3D segmentation. Experiments on ScanNet demonstrate superior 2D and 3D performance compared to other privacy‑preserving methods, strong zero‑shot transfer to SUN RGB‑D and SceneNN, and reduced recoverability of sensitive data, with real‑robot tests showing effective object‑goal navigation.

By Xuying Huang, Swithinraj Moses Daniel, Sicong Pan, Sebastian Houben, Maren Bennewitz
arXiv Computer Vision
Sep 18

Depth-Only Open-Vocabulary 3D Semantic Segmentation For Privacy-Preserving Robotic Applications

The paper introduces a privacy‑preserving approach to open‑vocabulary 3D semantic segmentation that operates solely on depth data, eliminating the use of RGB images to avoid disclosing scene‑specific visual information. It proposes a stricter depth‑only evaluation protocol and presents UTTO, a model‑agnostic uncertainty‑guided test‑time optimization framework that refines predictions from frozen open‑vocabulary 3D backbones using structured predictive uncertainty. Experiments on ScanNet and Matterport3D show consistent improvements, and additional analyses demonstrate the method’s relevance for privacy‑constrained robotic applications.

By Xuying Huang, Sicong Pan, Maren Bennewitz
arXiv AI
Sep 18

FedVideoMAE: Efficient Federated Video Moderation with Differential Privacy and Secure Aggregation

FedVideoMAE is a federated learning framework for short‑form video moderation that keeps raw videos on the device and uses a frozen VideoMAE backbone with lightweight LoRA and prompt parameters. Each training round performs self‑supervised masked video reconstruction while applying client‑side differential privacy and pairwise masked aggregation of adapter updates, keeping violence labels out of the federation. On the RWF‑2000 dataset, the method reduces the model‑state payload by 28.3× and achieves 77.25% accuracy without privacy mechanisms, dropping to 65.25–66.00% under differential privacy and secure aggregation.

By Ziyuan Tao, Chuanzhi Xu, Sandaru Jayawardana, Adnan Mahmood, Wei Bao, Kanchana Thilakarathna, Teng Joon Lim
arXiv Computer Vision
Oct 16

ResStreamGS: Residual-Sensitive Dual-Stream Gaussian Splatting for Mobile Volumetric Video Streaming

ResStreamGS introduces a residual‑sensitive dual‑stream framework for mobile volumetric video streaming that distinguishes temporally stable Gaussians from residual‑sensitive ones. Stable Gaussians are transmitted once per Group of Pictures, while only the residual‑sensitive Gaussians are included in the frame‑wise video stream, reducing bandwidth usage. Experiments on complex full‑scene videos show a 7.51–8.35 dB PSNR improvement over a V³‑style baseline, a payload reduction of up to 56.5%, and real‑time performance of 30.883 FPS on a Qualcomm Snapdragon 778G.

By Haoran Liu, Di Wu, Wang Luo, Hengyuan Na, Miao Hu, Guocong Quan