arXiv Machine Learning By Kangwen Zhao, Jianfeng Cai, Jinhua Zhu, Ruopei Sun, Dongyun Xue, Wengang Zhou, Li Li, Houqiang Li

Bias Fitting to Mitigate Length Bias of Reward Model in RLHF

Read the original on arXiv Machine Learning →

arXiv:2505. 12843v2 Announce Type: replace Abstract: Reinforcement Learning from Human Feedback (RLHF) relies on reward models to align large language models with human preferences.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.