arXiv Computation and Language

ProfileFoundry: A Synthetic Person-Object Substrate for Privacy, Memory, and Tool-Use Evaluation in LLM Agent

arXiv Computer Vision
Sep 14

BodhiPromptShield: Pre-Inference Prompt Mediation for Surface-Form Privacy Propagation in LLM Agent Pipelines

BodhiPromptShield is a policy‑aware mediation layer for LLM agent pipelines that detects sensitive text spans before they propagate, replacing them with typed placeholders, semantic abstractions, or secure tokens and restoring them only at authorized execution boundaries. In evaluations on AI4Privacy, PrivacyLens, and AgentDojo datasets, the system reduces identifier exposure to 7.4% and 1.8% respectively, and limits exact identifier leakage in final actions to 2.1–3.1%. While mediation preserves factual content according to automated metrics, human annotations show a significant drop in inferability from 100% to 24–53%, indicating the need for human validation of semantic‑leakage measures.

By Bo Ma, Jinsong Wu, Weiqi Yan
arXiv AI
Oct 2

Generation Provenance Before Behavior Attribution: Auditing Synthetic Speech Research Objects

The paper proposes a generation‑provenance substrate for synthetic speech research objects, binding source specifications, generated content, waveform, target, fact requirements, quality signals, review lineage, and an immutable manifest identity. It audits this substrate in a private Japanese care‑handoff pipeline, documenting 113 assets and 1.552 hours of synthetic speech with linked audio, transcripts, notes, and fact checklists, while noting selective human evidence and source‑specific gaps. The authors argue that provenance is necessary but not sufficient for behavior attribution, requiring additional frozen training runs and intervention evidence, and they provide a compact provenance contract, audit protocol, and a bounded case study. "whyItMatters":"The study highlights the need for detailed provenance records to enable reliable auditing and attribution of synthetic data behavior, underscoring limitations in current practices and offering a structured framework for future research."

By Sidi Chang, Peiying Zhu
arXiv Computation and Language
Sep 14

GraphProfiler: Source-Linked Sensitive Attribute Inference via Personal Knowledge Graphs

GraphProfiler is an auditable LLM-based profiler that infers sensitive attributes such as age, income, and occupation from user-generated content by aggregating indirect cues across many posts. It represents each user's post history as a source-linked personal knowledge graph, allowing predictions to be traced back to specific posts, concepts, and relationships. The system achieves an 86.7% success rate on the SynthPAI benchmark and 84.6% on PANDORA, citing supporting evidence for over 98% of predictions and demonstrating that cited posts significantly contribute to attack success.

By Ahmed Sohair Khan, Estrid He, Chenglong Ma, Monica Wachowicz, Elham Naghizade
arXiv AI
Jun 10

IDP-Bench: Benchmarking ability of LLMs to protect personal information in interdependent privacy contexts

arXiv:2606. 09908v1 Announce Type: cross Abstract: Large language models (LLMs) are becoming widely deployed as personal AI assistants with access to sensitive user data, making privacy a major challenge for their design and evaluation.

By Ayana Hussain, Soumya Sharma, Golnoosh Farnadi, Nicholas Vincent, H\'eber Hwang Arcolezi, Ulrich A\"ivodji
arXiv Machine Learning
Jul 20

Do Generative Models Keep Time? A Time-Aware Evaluation of Synthetic Sequential Tabular Data

arXiv:2607. 15606v1 Announce Type: new Abstract: Synthetic sequential tabular data are increasingly used for privacy-preserving data sharing, yet a generator can reproduce every marginal and every foreign-key relationship while emitting timestamps that run backwards or repeat, and while sending entities along paths that no real entity followed.

By Kiwan Kwon, Kangmin Kim, Hojin Lee, Yeseong Jung, Hyeongwoo Kong, Vamsi K. Potluru, Saerom Park, Yongjae Lee
arXiv AI
6d ago

ReCoPII: A Relation-Grounded Framework for Building Contextual PII Masking Datasets

ReCoPII is a relation‑grounded framework that generates contextual PII masking datasets without assuming a single data subject. It constructs ontology‑constrained entity relations, writes insertion sentences with placeholders, and derives MASK/KEEP labels through automated annotation and LLM verification. Applied to Korean documents across six domains, ReCoPII‑Ko achieves high agreement with human annotators (88.42% on KEEP labels) and improves masking performance compared to SPY‑style augmentation.

By Taehwan Lee