The paper argues that evaluating privacy‑enhancing technologies (PETs) solely through image classification is insufficient because classification remains robust to many geometric and local perturbations. It proposes a compute‑aware multi‑task protocol that uses lightweight proxy tasks to assess PETs across various transformations, revealing that PETs with similar classification accuracy can perform very differently on other vision tasks. The study demonstrates the necessity of broader evaluation metrics beyond classification to truly gauge PET effectiveness.
arXiv:2607. 08867v1 Announce Type: cross Abstract: Cloud-based deep learning enables large-scale medical image analysis but raises significant privacy concerns when sensitive patient images are outsourced for model development.
The paper investigates whether large, instruction‑following Vision‑Language Models (VLMs) can reliably perform zero‑shot image privacy classification. It compares three open‑source VLMs to specialized privacy models on two public benchmarks, evaluating accuracy, robustness to image degradations (compression, lighting changes, noise), inference speed, and parameter count. The findings show that while VLMs remain robust to perturbations, they are less accurate and significantly slower than smaller, purpose‑built privacy models, indicating that scaling alone does not guarantee effective privacy classification.
arXiv:2608.28691v1 Announce Type: cross Abstract: Wearable VLM pipelines promise continuous multimodal assistance from egocentric visual capture: a user asks a task-driven question about the surround...
HeteroPROMPT is a real‑time, privacy‑preserving framework for heterogeneous collaborative perception in autonomous systems. It aligns features from diverse sensors and models into a unified ego‑centric space using modular prompts and lightweight tuning, while keeping encoders and fusion stacks frozen. The system employs a metadata‑free autoencoder for modality classification and routing, achieving higher average precision on OPV2V‑H and V2XSet datasets with far fewer trainable parameters.
arXiv:2409. 01062v4 Announce Type: replace Abstract: Model Inversion (MI) attacks pose a significant privacy threat by reconstructing private training data from machine learning models.
arXiv:2608.23012v1 Announce Type: new Abstract: Image matching is a core component of applications such as Simultaneous Localization and Mapping (SLAM), Visual Localization, and Structure from Motion...
Image matching is a core component of applications such as Simultaneous Localization and Mapping (SLAM), Visual Localization, and Structure from Motion (SfM). However, the local image features central...
arXiv:2606. 09132v1 Announce Type: new Abstract: Visual Language Models (VLMs) have gained significant popularity due to their remarkable ability.
arXiv:2504. 14798v2 Announce Type: replace Abstract: Machine Unlearning (MUL) has emerged as a key mechanism for privacy protection and content regulation, yet current techniques often fail to guarantee the complete removal of sensitive information.
The paper introduces a new object detection approach that protects sensitive visual data in test images. It is the first to apply perceptual encryption to object detection, leveraging the embedding structure of Vision Transformers and a key-based domain adaptation to maintain accuracy comparable to unprotected models. Experiments on ViTdet confirm the method’s effectiveness in both accuracy and visual protection.
arXiv:2607. 14932v1 Announce Type: cross Abstract: Synthetic face datasets have become effective enough to train face recognition models with accuracy rivaling that of models trained on real photographs.
The paper introduces XCal-FL, a federated learning algorithm that dynamically calibrates differential privacy noise using three signals—prediction logit variations, counterfactual margins, and saliency concentration—to improve both predictive accuracy and explanation fidelity. Experiments on medical imaging datasets demonstrate that XCal-FL outperforms static-noise and state‑of‑the‑art adaptive DP methods, achieving over 10% better accuracy and up to fivefold higher explanation fidelity while using privacy budgets more efficiently. The study highlights that explanation fidelity behaves non‑linearly with privacy loss, indicating that explainability is a separate dimension of the privacy trade‑off.