arXiv AI
Aug 5
Enhancing VLM Reward Models Through Structure-Aware Fine-Tuning
arXiv:2608. 03875v1 Announce Type: cross Abstract: Designing effective reward functions remains a major bottleneck in Reinforcement Learning (RL).
Mitigating Reward Hacking in RLHF via Bayesian Non-negative Reward Modeling
arXiv:2602. 10623v2 Announce Type: replace-cross Abstract: Reward models learned from human preferences are central to aligning large language models (LLMs) via reinforcement learning from human feedback, yet they are often vulnerable to reward hacking due to noisy annotations and systematic biases such as response length or style.
Related stories
arXiv AI
Jun 16
Latent Thought Flow: Efficient Latent Reasoning in Large Language Models
arXiv:2606. 16222v1 Announce Type: new Abstract: Large Language Models (LLMs) increasingly rely on intermediate reasoning, yet explicit Chain-of-Thought (CoT) suffers from a linguistic space bottleneck: each thought must be decoded into tokens, causing high inference overhead.
arXiv AI
Jun 10
When Distance Distracts: Representation Distance Bias in BT-Loss for Reward Models
arXiv:2512. 06343v3 Announce Type: replace-cross Abstract: Reward models are central to Large Language Model (LLM) alignment within the framework of RLHF.
arXiv AI
Jun 19
Uncertainty-Aware Reward Modeling for Stable RLHF
arXiv:2606. 19818v1 Announce Type: cross Abstract: Reinforcement learning from human feedback (RLHF) aligns large language models by training reward models on preference data and optimizing policies to maximize predicted rewards.
arXiv Machine Learning
Jun 10
Gradient-Guided Reward Optimization for Inference-time Alignment
arXiv:2606. 09635v1 Announce Type: cross Abstract: Ensuring the reliability of Large Language Models (LLMs) under distribution drift requires inference-time adaptation.
arXiv AI
Jul 20
Debiasing Text-to-Image Evaluation via Implicit Cultural Alignment Reward Modeling
arXiv:2607. 15740v1 Announce Type: cross Abstract: As Text-to-Image (T2I) systems rapidly advance, evaluating the cultural authenticity of synthesized content has become increasingly important for fair and trustworthy generative AI.
arXiv AI
Jun 2
One Bias After Another: Mechanistic Reward Shaping and Persistent Biases in Language Reward Models
arXiv:2603. 03291v2 Announce Type: replace-cross Abstract: Reward Models (RMs) are crucial for online alignment of language models (LMs) with human preferences.
arXiv AI
Jul 7
MARS: Margin and Semantic-Aware Data Augmentation for Reward Modeling
arXiv:2602. 17658v3 Announce Type: replace-cross Abstract: Reward modeling is central to alignment pipelines such as RLHF, RLAIF, and PPO-based policy optimization, yet its reliability is constrained by limited and heterogeneous human preference data that are expensive to collect at scale.
Hugging Face Trending Papers
Aug 7
Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models
Diffusion models have strong generative capabilities. However, their maximum likelihood training objective only focuses on reconstructing the data distribution, making it difficult to align with specific preferences.
arXiv Machine Learning
Jun 8
AdaJudge: Adaptive Multi-Perspective Judging for Reward Modeling
arXiv:2601. 08097v2 Announce Type: replace-cross Abstract: Reward modeling is essential for aligning large language models with human preferences, yet predominant architectures rely on a static pooling strategy to condense sequences into scalar scores.
arXiv Machine Learning
Jul 31
Personalized RewardBench: Evaluating Reward Models with Human Aligned Personalization
arXiv:2604. 07343v2 Announce Type: replace-cross Abstract: Pluralistic alignment has emerged as a critical frontier in the development of Large Language Models (LLMs), with reward models (RMs) serving as a central mechanism for capturing diverse human values.
arXiv AI
Jun 26
Joint Reward Modeling: Internalizing Chain-of-Thought for Efficient Visual Reward Models
arXiv:2602. 07533v2 Announce Type: replace Abstract: Reward models are critical for reinforcement learning from human feedback, as they determine the alignment quality and reliability of generative models.