The paper investigates how to reduce the per-user adaptation burden in personalized large language models by separating reusable personalization capacity from user-specific adjustments. Through empirical studies, it shows that shared low‑rank factors can capture much of the cross‑user structure, while a tiny user code suffices for individual correction. The proposed LINEUP framework achieves state‑of‑the‑art performance on six personalized tasks while using only eight scalars per user compared to millions of private‑LoRA parameters.
By Songyuan Sui, Srikanth Malla, Chiho Choi, Joon Hee Choi
arXiv:2606. 05004v1 Announce Type: cross Abstract: With the widespread deployment of public large language models (LLMs) such as ChatGPT, protecting user prompt privacy has become an increasingly critical issue.
By Peihua Mai, Xuanrong Gao, Youlong Ding, Xianglong Du, Wei Liu, Yan Pang
PLUME is a lightweight framework for personalizing large language models by learning a shared task-specific subspace from aggregated user data and then training only a small square matrix for each user within that subspace. The approach introduces cross-layer shared parameters and rank‑1 residual terms to reduce redundancy while preserving expressiveness. Experiments on personalized text generation benchmarks show that PLUME matches or outperforms strong baselines while cutting per‑user parameters by over 95%.
By Xinyu Li, Hao Zhou, Jianfeng Zhu, Julina Maharjan, Ruixin Guo, Feodor Dragan, Ruoming Jin
arXiv:2609.24979v1 Announce Type: new
Abstract: On-device large language models (`LLMs'), e.g. running on mobile phones, are ripe for improvement via personalization. The limited compute resources of...
By Sean Augenstein, Li Ding, Jihwan Lee, Keith Rush, Andrey Zhmoginov
On-device large language models (`LLMs'), e.g. running on mobile phones, are ripe for improvement via personalization. The limited compute resources of mobile devices impose limits on model scale and...
arXiv:2608. 05246v1 Announce Type: new Abstract: Existing personalized LLM benchmarks primarily rely on textual personas or isolated behavioral signals, providing limited evaluation of cross-domain behavioral personalization, where responses must be grounded in heterogeneous daily-life activities.
By Jiahao Zhang, Yongzhi Tong, Zelin Fu, Pengde Zhao, Yanmei Jiang, Jiang Feng, Min Yang