The paper "Evaluating Style-Personalized Text Generation: Challenges and Directions" examines the difficulties of assessing text that is tailored to individual users’ styles. It critiques common metrics such as BLEU, embeddings, and LLM-as-judges, and introduces a style discrimination benchmark covering domain discrimination, authorship attribution, and LLM-generated personalized versus non-personalized discrimination across eight writing tasks. The study finds that ensembles of diverse evaluation metrics outperform single-evaluator approaches and offers guidance for reliable assessment of style-personalized generation.
By Anubhav Jangra, Bahareh Sarrafzadeh, Silviu Cucerzan, Adrian de Wynter, Sujay Kumar Jauhar
arXiv:2608. 19746v1 Announce Type: new Abstract: Personalized text generation aims to make LLMs write in a specific individual's style, yet existing benchmarks measure task accuracy or preference alignment rather than whether the model's output actually resembles the target author's writing.
By Yash Ganpat Sawant
AuthorMix is a lightweight, modular framework for authorship style transfer that uses layer‑wise adapter mixing. It trains individual style‑specific LoRA adapters on a small set of high‑resource authors, enabling rapid adaptation to new target styles with only a few examples. The method achieves the highest combined style‑meaning score among baselines, including GPT‑5.1, and improves meaning preservation, as confirmed by human evaluation.
By Sarubi Thillainathan, Ji-Ung Lee, Michael Sullivan, Alexander Koller
arXiv:2508. 01656v2 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) have reached human-like fluency and coherence, distinguishing machine-generated text (MGT) from human-written content becomes increasingly difficult.
By Lucio La Cava, Dominik Macko, R\'obert M\'oro, Ivan Srba, Andrea Tagarelli
Authorship verification (AV) assumes that an author's writing style remains sufficiently stable to distinguish it from that of other writers. In practice, however, this assumption is challenged by dis...
arXiv:2608.23124v1 Announce Type: cross
Abstract: Personalized text generation for authors and literary writing is essential for applications such as adaptive writing assistants, creative support too...
By Jinghui Zhang, Lang Gao, Ao Li, Mingzhe Li, Ruihong Zeng, Zirui Song, Kentaro Inui, Xiuying Chen