Hugging Face Trending Papers

Reproducing Transparent and Scrutable Recommendations: Exploring Open-Weight Models via Natural-Language User Profiles

Read the original on Hugging Face Trending Papers →

The study reproduces a prior work on recommender systems that use generated natural‑language user profiles to enhance transparency and user control. It confirms that the User Profile Recommendation (UPR) model performs competitively and that altering these profiles uniformly shifts predicted ratings without changing ranking order. Additional experiments include context ablation, multi‑seed stability, and mechanistic interpretability analysis with the nnsight framework.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI
Sep 18

Reproducing Transparent and Scrutable Recommendations: Exploring Open-Weight Models via Natural-Language User Profiles

This reproducibility study confirms that incorporating generated natural‑language user profiles into recommender systems enhances transparency and allows users to directly intervene by correcting preferences or addressing cold‑start issues. The authors replicated the original findings and extended the evaluation with context ablation, multi‑seed stability tests, and mechanistic interpretability analysis using nnsight. Their results show that while perturbing profiles shifts predicted ratings uniformly across genres, the overall rankings remain unchanged, attributing this to the rating‑regression objective rather than the profile interface.

By Noah Mami\'e, Laurin van den Bergh
arXiv AI
Sep 23

Beyond Raw Engagement: A Counterfactual Observability Framework for Recommender Systems at Netflix

The paper introduces a counterfactual observability framework for Netflix’s recommender systems, aiming to disentangle raw engagement signals—such as views and clicks—from confounding factors like content quality, model behavior, presentation bias, and audience reach. It proposes three stakeholder‑centered principles and measurement methods that reduce bias, assess relativity, and capture incrementality, applicable to both single‑stage and cascading recommender architectures. The framework is demonstrated through multiple production deployments, showing its effectiveness in enhancing observability across Netflix’s recommendation pipelines.

By Chaoran Guo, Ding Tong, Ting-Po Lee, Scarlet Chen
arXiv AI
6d ago

From Counterfactual Edits to Human Narratives: LLM-Driven Interpretations for Recommender System Explanations

The paper explores how large language models can transform extensive counterfactual edit lists from recommender systems into concise, natural‑language explanations that highlight higher‑level preference patterns. By optimizing these mediators for correctness, informativeness, and linguistic quality, the authors demonstrate that the resulting summaries maintain high linguistic quality and improve semantic coherence, especially when paired with effective counterfactual generators like ACCENT and SPINRec. Human‑calibrated metrics confirm that preference optimization enhances the overall quality of the explanations across multiple settings.

By Vojtech Cahlik, Amir Reza Mohammadi, Rodrigo Alves, Pavel Kordik, Eva Zangerle
arXiv AI
Sep 3

The Utility of LLMs in Recommender Systems Explanation Evaluation

The paper investigates how large language models (LLMs) can evaluate explanations in recommender systems. It generates 18 explanation prototypes and has 14 LLMs rate them, comparing the results to human ratings from a user study. Findings show that while LLMs mimic human rating patterns and correlate moderately with human judgments, their absolute agreement is low and varies with model size and evaluation design, leading to four practical recommendations for using LLMs in this context.

By Kathrin Wardatzky, Oana Inel, Luca Rossetto, Abraham Bernstein
arXiv AI
Oct 31

Statistical Detection of Positional Bias in LLM-Based Recommender Systems: Methodologies and Empirical Evidence

The paper investigates positional bias in large language model (LLM)–based recommender systems that use retrieval‑augmented generation (RAG). It introduces two statistical detection methods—POB‑ICM and POB‑UNBP—to test whether the recommended item depends on the order of candidates in the prompt. Experiments on a product‑recommendation testbed with 40,000 instances show that all evaluated state‑of‑the‑art models exhibit significant positional bias, quantified by new metrics such as permutation sensitivity and strong positional bias, and that this bias is structural and model‑dependent rather than an artifact of decoding or candidate‑set size.

By Carlos Pel\'aez-Gonz\'alez, Francisco Herrera, Andr\'es Herrera-Poyatos