arXiv AI
Jun 9
Vision Language Model Helps Private Information De-Identification in Vision Data
arXiv:2606. 09132v1 Announce Type: new Abstract: Visual Language Models (VLMs) have gained significant popularity due to their remarkable ability.
Defending Wearable VLMs Against Private Attribute Inference
Related stories
arXiv Machine Learning
Aug 20
On the Robustness of Vision-Language Models in Zero-shot Privacy Classification
The paper investigates whether large, instruction‑following Vision‑Language Models (VLMs) can reliably perform zero‑shot image privacy classification. It compares three open‑source VLMs to specialized privacy models on two public benchmarks, evaluating accuracy, robustness to image degradations (compression, lighting changes, noise), inference speed, and parameter count. The findings show that while VLMs remain robust to perturbations, they are less accurate and significantly slower than smaller, purpose‑built privacy models, indicating that scaling alone does not guarantee effective privacy classification.
arXiv Computer Vision
Aug 24
Masking Is Not Enough: Generative Restoration for Multimodal De-Identification in Medical AI
arXiv:2608.21133v1 Announce Type: new Abstract: Medical image-text data can expose protected health information (PHI) through both visible image content as well as accompanying text, creating a barri...
arXiv Computer Vision
3d ago
HeteroPROMPT: A Real-time and Privacy-Preserving Heterogeneous Collaborative Perception Framework
HeteroPROMPT is a real‑time, privacy‑preserving framework for heterogeneous collaborative perception in autonomous systems. It aligns features from diverse sensors and models into a unified ego‑centric space using modular prompts and lightweight tuning, while keeping encoders and fusion stacks frozen. The system employs a metadata‑free autoencoder for modality classification and routing, achieving higher average precision on OPV2V‑H and V2XSet datasets with far fewer trainable parameters.
arXiv Machine Learning
Aug 13
LEMUR: Latent Entropy-aware Multimodal Unlearning via Visual-anchored Reasoning Redirection
arXiv:2608. 11691v1 Announce Type: new Abstract: Reinforcement-learning (RL) post-training equips multimodal large reasoning models (MLRMs) with exploratory chains of thought (CoT), substantially improving visual reasoning.
arXiv AI
Jun 18
TRAP: Benchmark for Task-completion and Resistance to Active Privacy-extraction
arXiv:2606. 18996v1 Announce Type: cross Abstract: Agents are increasingly deployed in document-intensive workflows where sensitive private information is not an edge case but a routine input, e.
arXiv AI
Aug 28
Beyond Classification: Task-Dependent Learnability under Privacy-Motivated Image Transformations
The paper argues that evaluating privacy‑enhancing technologies (PETs) solely through image classification is insufficient because classification remains robust to many geometric and local perturbations. It proposes a compute‑aware multi‑task protocol that uses lightweight proxy tasks to assess PETs across various transformations, revealing that PETs with similar classification accuracy can perform very differently on other vision tasks. The study demonstrates the necessity of broader evaluation metrics beyond classification to truly gauge PET effectiveness.
arXiv Machine Learning
Jul 16
When T2I Synthetic Data Backfires: Amplified Privacy Risks in Real-Synthetic Mix Training
arXiv:2607. 13541v1 Announce Type: cross Abstract: To overcome data scarcity and privacy constraints in data collection, it has become standard practice across academia and industry to augment real training data with text-to-image (T2I)-generated synthetic data, a paradigm we term Real-Synthetic Mix-Training (RSMT).
arXiv AI
Jun 16
Are Neuro-Inspired Multi-Modal Vision-Language Models Resilient to Membership Inference Privacy Leakage?
arXiv:2511. 20710v2 Announce Type: replace-cross Abstract: In the age of agentic AI, the growing deployment of multi-modal models (MMs) has introduced new attack vectors that can leak sensitive training data in MMs, causing privacy leakage.
arXiv AI
Jul 7
PPE-Bench: A Benchmark for Evaluating MLLM Unlearning under Private-Public Entanglement
arXiv:2607. 02897v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have shown strong capabilities, but they may memorize private information from web data, raising privacy concerns.
arXiv Machine Learning
Aug 18
A Privacy Study of Sparse Collaborative Inference
arXiv:2608. 16236v1 Announce Type: new Abstract: Collaborative inference (CI) splits a model between an edge device and a server, whereby the client computes an intermediate activation, transmits it, and the server completes the computation.
arXiv AI
Jun 8
What Your Posts Reveal: A Benchmark and Agentic Framework for User-Level Privacy Leakage on Social Media
arXiv:2606. 06784v1 Announce Type: cross Abstract: Public social media posts can reveal private information through weak cues scattered across text, images, or metadata.