arXiv Machine Learning

Secrets Everywhere: Auditing Memorization in Mobility Prediction Models

arXiv:2608. 02052v1 Announce Type: new Abstract: Human mobility prediction models, which forecast the next location in a user's trajectory, are increasingly deployed in urban analytics, navigation, and personalized services.

arXiv Machine Learning
Sep 2

Do LLMs Know Your Neighborhood? Auditing LLM Priors for Neighborhood-Level Mobility Prediction and Structural Alignment

The study investigates whether large language models (LLMs) can predict neighborhood-level human mobility without training data. Using anonymized Cuebiq data across four U.S. metropolitan areas, the authors compare zero‑shot LLM predictions to supervised baselines for various mobility outcomes and assess structural alignment with empirical trends. Results show supervised models outperform LLMs (average accuracy 0.580 vs. 0.435), with LLMs relying on coarse, stable priors that may exhibit biased treatment of protected-group predictors.

By Saad Mohammad Abrar, Eesha Kurella, Arnav Dadarya, Naman Awasthi, Kazi Tasnim Zinat, Vanessa Frias-Martinez
arXiv Computation and Language
Sep 2

Membership Inference in Fine-tuned Diffusion Language Models via Token-level Memorization Asymmetry

The paper introduces a new privacy vulnerability in diffusion language models (DLMs) called token‑level memorization asymmetry, derived from theoretical analysis of diffusion training dynamics. It proposes Q‑Skew, a quantile‑weighted skewness indicator, to perform membership inference on fine‑tuned DLMs, outperforming existing baselines across multiple datasets and models. Additionally, Q‑Skew can be used to extract personally identifiable information (PII), demonstrating a broader privacy attack surface.

By Shengfang Zhai, Leo Marchyok, Yuling Shi, Huanran Chen, Yinpeng Dong, Jiaheng Zhang, Sanghyun Hong
arXiv AI
Jul 10

MobiDiff: Semantic-Aware Multi-Channel Discrete Diffusion for Human Mobility Data Generation

arXiv:2607. 08357v1 Announce Type: new Abstract: Human mobility data are essential for transportation optimization, urban planning, and resource allocation, yet real-world mobility data are costly to collect and difficult to share due to privacy concerns.

By Rongchao Xu, Lin Jiang, Dahai Yu, Ximiao Li, Taichi Liu, Desheng Zhang, Yuan Tian, Guang Wang
arXiv AI
Aug 7

LUNAR: Benchmarking Personalized Large Language Models on UNiversal User BehAvioR Logs

arXiv:2608. 05246v1 Announce Type: new Abstract: Existing personalized LLM benchmarks primarily rely on textual personas or isolated behavioral signals, providing limited evaluation of cross-domain behavioral personalization, where responses must be grounded in heterogeneous daily-life activities.

By Jiahao Zhang, Yongzhi Tong, Zelin Fu, Pengde Zhao, Yanmei Jiang, Jiang Feng, Min Yang
arXiv AI
Sep 4

VoxPrivacy: A Benchmark for Evaluating Interactional Privacy of Speech Language Models

The paper introduces VoxPrivacy, a benchmark for assessing interactional privacy in Speech Language Models (SLMs). It evaluates models on a 32‑hour bilingual dataset across three difficulty tiers, revealing that most open‑source SLMs perform near random on conditional privacy decisions and even strong closed‑source systems struggle with proactive privacy inference. The authors also validate these findings on a real‑speech subset and show that fine‑tuning on a 4,000‑hour training set can improve privacy‑preserving capabilities while maintaining robustness.

By Yuxiang Wang, Hongyu Liu, Dekun Chen, Xueyao Zhang, Zhizheng Wu
arXiv Machine Learning
Sep 7

BER-PEF: Unified Human Mobility Predictability Evaluation via Bayes Error Rate Estimation

BER-PEF is a Bayes‑error‑rate‑based framework that transforms BER estimation into human mobility predictability estimation, enabling comparison of different estimators even when ground truth predictability is not observable. It maps various data types—symbolic sequences, numeric trajectories, contextual features, and learned representations—into a shared feature–label space and evaluates estimator outputs along controlled perturbation curves against a common predictability reference interval. Experiments on datasets such as Foursquare NYC/TKY, GeoLife, and T‑Drive show that several BER‑based estimators outperform existing methods on symbolic sequences and numeric trajectories, and that aggregating evidence across multiple perturbation levels yields a more reliable basis for selecting estimators.

By En Xu, Jingtao Ding, Zhiwen Yu, Yong Li
arXiv Machine Learning
Jun 2

Causal Evaluation of Membership Inference Attacks

arXiv:2602. 02819v4 Announce Type: replace Abstract: Membership Inference Attacks (MIAs) aim to distinguish training points (members) from unseen data (non-members), and are widely used to quantify memorization and assess privacy risks.

By Mathieu Even, Cl\'ement Berenfeld, Linus Bleistein, Tudor Cebere, Julie Josse, Aur\'elien Bellet
arXiv Machine Learning
Sep 17

Behavioral Fingerprinting and Navigation Prediction in Web Browsing

The study examines two behavioral inference tasks—session-level user identification and next-domain prediction—using large-scale anonymous web browsing traces. Classical and neural models are applied to user identification, while graph-based methods combined with Large Language Models (LLMs) are used for next-domain prediction. Results show that short browsing sessions are highly identifiable and future navigation is highly predictable, with LLM-derived semantic features offering only marginal improvements over structural and sequential models.

By Ralph Elsaghbini, Omran Berjawi, Walid Fahs, Rida Khatoun