arXiv AI By Liuji Chen, Zeyu Zhang, Xinyuan Zhang, Shuai Nie, Qiang Liu, Shu Wu, Liang Wang

From Profiles to Steering Vectors: Global Sparse Priors and Local Semantic Calibration for Personalized Text Generation

Read the original on arXiv AI →

The paper introduces GLASS, a training‑free framework that personalizes text generation by combining global user‑style priors extracted with sparse autoencoders and local contrastive style vectors built from clustered interaction scenarios. During inference, GLASS injects these global and local vectors into different model layers, achieving context‑aware personalization without retrieval or parameter updates. Experiments on LaMP and LongLaMP datasets demonstrate that GLASS surpasses retrieval, fine‑tuning, and other steering baselines on ROUGE metrics and LLM‑as‑judge evaluations, and its SAE‑based representations show robustness to topic and length shifts, indicating better disentanglement of style from content.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 15

Iterative Critique-Refine Framework for Enhancing LLM Personalization

The paper introduces PerFine, a training‑free critique‑refine framework that improves large language model personalization. In each iteration, a generator drafts text conditioned on a retrieved user profile, while a critic—also conditioned on the same profile—provides structured feedback on tone, vocabulary, sentence structure, and topicality. The generator revises the draft, and a knockout strategy selects the best version across iterations; additional inference‑time techniques such as Best‑of‑N and Topic Extraction further balance quality and efficiency. Experiments on Yelp, Goodreads, and Amazon datasets show PerFine consistently outperforms existing retrieval‑augmented methods like PGraphRAG, achieving G‑Eval gains of +8.5‑12% and steady improvements over 3‑5 refinement iterations.

By Durga Prasad Maram, Dhruvin Gandhi, Zonghai Yao, Gayathri Akkinapalli, Franck Dernoncourt, Yu Wang, Ryan A. Rossi, Nesreen K. Ahmed
arXiv AI
Aug 18

Reasoning-Based Personalized Generation for Users with Sparse Data

arXiv:2602. 21219v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) personalization holds great promise for tailoring responses by leveraging personal context and history.

By Bo Ni, Branislav Kveton, Samyadeep Basu, Subhojyoti Mukherjee, Leyao Wang, Franck Dernoncourt, Sungchul Kim, Seunghyun Yoon, Zichao Wang, Ruiyi Zhang, Puneet Mathur, Jihyung Kil, Jiuxiang Gu, Nedim Lipka, Yu Wang, Ryan A. Rossi, Tyler Derr
arXiv Computation and Language
Sep 2

Evaluating Style-Personalized Text Generation: Challenges and Directions

The paper "Evaluating Style-Personalized Text Generation: Challenges and Directions" examines the difficulties of assessing text that is tailored to individual users’ styles. It critiques common metrics such as BLEU, embeddings, and LLM-as-judges, and introduces a style discrimination benchmark covering domain discrimination, authorship attribution, and LLM-generated personalized versus non-personalized discrimination across eight writing tasks. The study finds that ensembles of diverse evaluation metrics outperform single-evaluator approaches and offers guidance for reliable assessment of style-personalized generation.

By Anubhav Jangra, Bahareh Sarrafzadeh, Silviu Cucerzan, Adrian de Wynter, Sujay Kumar Jauhar
arXiv Computation and Language
Aug 25

Syntax-Guided Diffusion Language Models with User-Integrated Personalization

The paper introduces a syntax-guided diffusion language model that incorporates structural supervision and personalized conditioning to improve text quality, diversity, and controllability. It presents a cascaded framework generating syntactic guidance before text generation, and a novel noncascaded architecture for better structure-content alignment. A shared representation mechanism enables fine‑grained personalization across users, achieving faithful stylistic generation and zero‑shot inference, with experiments showing superior fluency, diversity, and stylistic fidelity.

By Ruqian Zhang, Yijiao Zhang, Juan Shen, Zhongyi Zhu, Annie Qu
arXiv Machine Learning
Sep 10

Disentangling Steering Vectors

arXiv:2609.07037v1 Announce Type: new Abstract: Activation steering has emerged as a lightweight, inference-time approach to control the behavior of Large Language Models (LLMs). However, traditional...

By Takeru Hiramatsu, Kyohei Atarashi, Koh Takeuchi, Hisashi Kashima