arXiv AI

Encoded but Exposed: Language Embeddings can Reveal More Than They Should in Recommender Systems

The paper investigates privacy risks of language embeddings used in recommender systems. It demonstrates that a simple cosine‑similarity attack can recover item identities with high accuracy when an adversary has auxiliary text, even when the descriptions are independently sourced. The study also shows that such leakage can lead to user re‑identification from sparse ratings and evaluates obfuscated descriptions as a mitigation, revealing a trade‑off between privacy and utility.

arXiv Machine Learning
Jul 3

Embedding Inference Attack

arXiv:2607. 01276v1 Announce Type: cross Abstract: Embedding models are essential components of modern Information Retrieval (IR) systems, yet they are typically hidden behind APIs.

By Cedric Fitiavana Raelijohn, S\'ebastien Gambs, Jean-Francois Rajotte
arXiv AI
Sep 18

Reproducing Transparent and Scrutable Recommendations: Exploring Open-Weight Models via Natural-Language User Profiles

This reproducibility study confirms that incorporating generated natural‑language user profiles into recommender systems enhances transparency and allows users to directly intervene by correcting preferences or addressing cold‑start issues. The authors replicated the original findings and extended the evaluation with context ablation, multi‑seed stability tests, and mechanistic interpretability analysis using nnsight. Their results show that while perturbing profiles shifts predicted ratings uniformly across genres, the overall rankings remain unchanged, attributing this to the rating‑regression objective rather than the profile interface.

By Noah Mami\'e, Laurin van den Bergh
Hugging Face Trending Papers
Sep 17

Reproducing Transparent and Scrutable Recommendations: Exploring Open-Weight Models via Natural-Language User Profiles

The study reproduces a prior work on recommender systems that use generated natural‑language user profiles to enhance transparency and user control. It confirms that the User Profile Recommendation (UPR) model performs competitively and that altering these profiles uniformly shifts predicted ratings without changing ranking order. Additional experiments include context ablation, multi‑seed stability, and mechanistic interpretability analysis with the nnsight framework.

arXiv Machine Learning
Aug 27

Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generation

The paper surveys attacks and defenses in Retrieval-Augmented Generation (RAG), a technique that improves large language models by grounding outputs in external knowledge. It identifies new robustness and security risks such as corpus poisoning, backdoor attacks, privacy leakage, and fairness violations, and notes that existing surveys inadequately cover attacker objectives, threat models, and stage-specific defenses. The survey offers a unified, pipeline-aware overview, formalizing threat models across the corpus, retriever, and generator, categorizing attacks by accuracy, privacy, and fairness, and reviewing defenses for retrieval, rerank, generation, and traceback stages, while also summarizing robustness benchmarks and explainability methods.

By Minh Tran, Cuong Dang, Tuc Nguyen, Khanh-Tung Tran, Minh Huynh Nguyen, Trinh Chau, Kien Le, Do Xuan Long, Jiahao Zhang, Hoang D. Nguyen, Thanh Le, Suhang Wang
arXiv Machine Learning
Oct 2

VirusCascade: Hijacking Collaborative Reflection in LLM-Powered Recommender Agents

The paper introduces VirusCascade, a black‑box attack that exploits the collaborative reflection mechanism in LLM‑powered recommender agents. By leveraging reflective persistence and cross‑agent propagation, the attack promotes a target item through semantic rationalisation and structural positioning, achieving state‑of‑the‑art targeted exposure on four real‑world datasets. The study demonstrates that existing static‑pipeline attacks cannot exploit this recurrent, multi‑agent amplification pathway.

By Yurong Hao, Wen Zhou, Guowei Guan, Tiantong Wu, Fuyao Zhang, Wei Yang Bryan Lim
arXiv AI
Jun 9

TRACER: Token ReAssignment for Concept ERasure in Generative Recommendation

arXiv:2606. 07688v1 Announce Type: cross Abstract: Generative recommendation formulates next-item prediction as autoregressive generation over semantic ID (SID) sequences derived from users' historical interactions, making modern recommender systems structurally similar to large language models (LLMs).

By Ziheng Chen, Jiali Cheng, Zezhong Fan, Hadi Amiri, Diyuan Wu, Gabriele Tolomei, Yang Zhang
arXiv AI
Oct 16

Private Retrieval Augmented Generation via Random Projection

The paper introduces a lightweight privacy-preserving technique for Retrieval-Augmented Generation (RAG) systems that uses random projection to transform both datastore and query embeddings. This approach maintains semantic similarity for effective retrieval while significantly reducing the risk of data extraction attacks. Experiments across various RAG architectures and datasets demonstrate that the method outperforms prior differential privacy-based techniques in both retrieval and generation performance while offering comparable empirical privacy.

By Dixi Yao, Tahseen Rabbani, Tian Li
arXiv Computation and Language
Sep 2

VerTox: Verifiable Reward-Guided Corpus Poisoning Against Neural Ranking Models

VerTox is a framework that turns corpus poisoning of neural ranking models into a verifiable reward‑guided reinforcement learning problem. By fine‑tuning compact large language models with reward shaping that couples ranking distortion and factual corruption, VerTox generates fluent, low‑perplexity adversarial documents that frequently outrank target items across multiple ranking architectures, including a commercial embedding model. Experiments show near‑perfect attack success and significant degradation of downstream retrieval‑augmented generation performance.

By Zhiqi Huang, Vivek Datla, Zhichao Xu, Puxuan Yu, Vivek Srikumar, Alfy Samuel