arXiv Machine Learning August 4, 2026 By Brahim Driss, Alex Davey, Riad Akrour

PB$^2$: Preference Space Exploration via Population-Based Methods in Preference-Based Reinforcement Learning

Read the original on arXiv Machine Learning →

arXiv:2506. 13741v2 Announce Type: replace-cross Abstract: Preference-based reinforcement learning (PbRL) has emerged as a promising approach for learning behaviors from human feedback without predefined reward functions.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 11

Multi-Agent Reinforcement Learning via Agent-Specific Preference

arXiv:2608. 08604v1 Announce Type: new Abstract: Multi-agent reinforcement learning (MARL) is a powerful framework for solving complex collaborative tasks, but it relies heavily on well-defined global reward functions.

By Ni Mu, Yao Luan, Yiqin Yang, Qing-Shan Jia

agents reinforcement-learning benchmarks

arXiv AI

Jun 18

UBP2: Uncertainty-Balanced Preference Planning for Efficient Preference-based Reinforcement Learning

arXiv:2606. 19328v1 Announce Type: cross Abstract: Preference-based RL provides an approach to learning reward models from pairwise comparisons of behaviors, bypassing the need for explicit reward design.

By Mohamed Nabail, Leo Cheng, Jingmin Wang, Nicholas Rhinehart

reinforcement-learning benchmarks

arXiv AI

Jul 7

Adaptive Margin RLHF via Preference over Preferences

arXiv:2509. 22851v4 Announce Type: replace-cross Abstract: Margin-based optimization is fundamental to improving generalization and robustness in classification tasks.

By Yaswanth Chittepu, Prasann Singhal, Greg Durrett, Scott Niekum

reinforcement-learning safety

arXiv Machine Learning

Jun 2

From Reward-Free Representations to Preferences: Rethinking Offline Preference-Based Reinforcement Learning

arXiv:2606. 01123v1 Announce Type: new Abstract: Preference-based reinforcement learning (PbRL) avoids explicit reward engineering by learning from pairwise human preference feedback.

By Jun-Jie Yang, Chia-Heng Hsu, Kui-Yuan Chen, Ping-Chun Hsieh

reinforcement-learning fine-tuning

arXiv AI

Jun 2

Efficient Exploration for Iterative Nash Preference Optimization

arXiv:2606. 01382v1 Announce Type: cross Abstract: Preference alignment is central to improving large language models, but standard reward-based formulations can be restrictive when human preferences are cyclic, non-transitive, or otherwise not representable by a scalar reward.

By Tianlong Nan, Xiaopeng Li, Christian Kroer, Tianyi Lin

llms fine-tuning benchmarks safety

arXiv Machine Learning

Jul 14

Generalizing Preference-based Reinforcement Learning: a Rationality Model for Incomparability

arXiv:2607. 11432v1 Announce Type: new Abstract: In this work, we study the reinforcement learning (RL) problem from pairwise trajectory comparisons provided by a human expert.

By Simone Drago, Marco Mussi, Leonardo Bianconi, Alberto Maria Metelli

reinforcement-learning

Related stories

Multi-Agent Reinforcement Learning via Agent-Specific Preference

UBP2: Uncertainty-Balanced Preference Planning for Efficient Preference-based Reinforcement Learning

Adaptive Margin RLHF via Preference over Preferences

From Reward-Free Representations to Preferences: Rethinking Offline Preference-Based Reinforcement Learning

Efficient Exploration for Iterative Nash Preference Optimization

Generalizing Preference-based Reinforcement Learning: a Rationality Model for Incomparability