arXiv Computation and Language By Furkan Yasir Goksu, Yaren Yilmaz, Sule Gunduz Oguducu

Preprocessing Choices in Fine-Tuning Data Matter: Utility and Demographic Sensitivity in LLM-Based Recommendation

Read the original on arXiv Computation and Language →

The paper examines how different preprocessing steps in fine‑tuning data influence the performance and fairness of a generative large language model recommender system. Using a controlled pipeline that includes supervised fine‑tuning, catalog‑constrained decoding, and prompt augmentation, the authors evaluate three preprocessing choices—item‑title representation, demographic balancing, and auxiliary item‑knowledge enrichment—on the MovieLens‑1M dataset. Results show that catalog constraints eliminate out‑of‑catalog items, prompt augmentation improves consistency and utility, and that demographic balancing and knowledge enrichment can reduce utility gaps for certain groups while preserving overall performance, though gender balancing may lower utility without improving gender indicators.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Jun 2

GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networks

arXiv:2506. 16114v3 Announce Type: replace-cross Abstract: Generative recommendations (GR), which usually include item tokenizers and generative Large Language Models (LLMs), have demonstrated remarkable success across a wide range of scenarios.

By Yejing Wang, Shengyu Zhou, Jinyu Lu, Qidong Liu, Xinhang Li, Wenlin Zhang, Feng Li, Pengjie Wang, Chuan Yu, Jian Xu, Bo Zheng, Xiangyu Zhao
arXiv AI
Sep 18

Reproducing Transparent and Scrutable Recommendations: Exploring Open-Weight Models via Natural-Language User Profiles

This reproducibility study confirms that incorporating generated natural‑language user profiles into recommender systems enhances transparency and allows users to directly intervene by correcting preferences or addressing cold‑start issues. The authors replicated the original findings and extended the evaluation with context ablation, multi‑seed stability tests, and mechanistic interpretability analysis using nnsight. Their results show that while perturbing profiles shifts predicted ratings uniformly across genres, the overall rankings remain unchanged, attributing this to the rating‑regression objective rather than the profile interface.

By Noah Mami\'e, Laurin van den Bergh