Hugging Face Trending Papers July 1, 2026

Multi-Objective Exploration and Preference Optimization via Mutual Information

Read the original on Hugging Face Trending Papers →

Aligning large language models with diverse and heterogeneous human values requires multi-objective alignment methods to effectively trade off conflicting preference dimensions. Current methods achieve this trade-off by training policies conditioned on preference vectors and leveraging online direct preference optimization.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

arXiv Machine Learning

Jun 8

Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models

arXiv:2505. 10892v2 Announce Type: replace Abstract: Post-training LLMs with RLHF and preference optimization methods (e.

By Akhil Agnihotri, Rahul Jain, Deepak Ramachandran, Zheng Wen

llms reinforcement-learning fine-tuning benchmarks safety

arXiv AI

Jul 7

Adaptive Margin RLHF via Preference over Preferences

arXiv:2509. 22851v4 Announce Type: replace-cross Abstract: Margin-based optimization is fundamental to improving generalization and robustness in classification tasks.

By Yaswanth Chittepu, Prasann Singhal, Greg Durrett, Scott Niekum

reinforcement-learning safety

arXiv AI

Jun 4

Sparse Mixture-of-Experts Reward Models Learn Interpretable and Specialized Experts for Personalized Preference Modeling

arXiv:2606. 04284v1 Announce Type: cross Abstract: Preference modeling plays a central role in reinforcement learning from human feedback (RLHF), enabling large language models (LLMs) to align with human values.

By Yifan Wang, Jinyi Mu, Mayank Jobanputra, Yu Wang, Ji-Ung Lee, Soyoung Oh, Isabel Valera, Vera Demberg

llms reinforcement-learning safety

arXiv AI

Jun 10

A Comprehensive Survey of Direct Preference Optimization: Datasets, Theories, Variants, and Applications

arXiv:2410. 15595v4 Announce Type: replace Abstract: With the rapid advancement of large language models (LLMs), aligning policy models with human preferences has become increasingly critical.

By Wenyi Xiao, Zechuan Wang, Leilei Gan, Shuai Zhao, Zongrui Li, Ruirui Lei, Wanggui He, Luu Anh Tuan, Long Chen, Hao Jiang, Zhou Zhao, Fei Wu

llms reinforcement-learning safety

arXiv Machine Learning

Jun 30

REAR: Test-time Preference Realignment through Reward Decomposition

arXiv:2606. 30339v1 Announce Type: cross Abstract: Aligning large language models (LLMs) with diverse user preferences is a critical yet challenging task.

By Fuxiang Zhang, Pengcheng Wang, Chenran Li, Yi-Chen Li, Yuxin Chen, Lang Feng, Chenfeng Xu, Masayoshi Tomizuka, Bo An

llms safety

arXiv AI

Jul 24

Reliability-Aware LLM Alignment from Inconsistent Human Feedback

arXiv:2607. 20515v1 Announce Type: new Abstract: Reinforcement Learning from Human Feedback (RLHF) is critical for aligning Large Language Models (LLMs) with human preferences.

By Jingyi Huang, Ruohan Zong, Yujun Feng, Liran Ma, Lanyu Shang, Yang Zhang

llms reinforcement-learning benchmarks safety

Related stories

Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models

Adaptive Margin RLHF via Preference over Preferences

Sparse Mixture-of-Experts Reward Models Learn Interpretable and Specialized Experts for Personalized Preference Modeling

A Comprehensive Survey of Direct Preference Optimization: Datasets, Theories, Variants, and Applications

REAR: Test-time Preference Realignment through Reward Decomposition

Reliability-Aware LLM Alignment from Inconsistent Human Feedback