Hugging Face Trending Papers

Spurious Advantage Hidden in GRPO

Read the original on Hugging Face Trending Papers →

The paper identifies a flaw in Group Relative Policy Optimization (GRPO) called the spurious advantage, where the advantage estimator can incorrectly reward rollouts that reach correct answers by guessing rather than reasoning. This issue appears in bounded-answer tasks, open-answer sets with bounded sub-cases, and search agents with many paths to the same answer. The authors propose SIGNBALANCE, a new magnitude estimator that removes composition, maintains verifier sign, applies a global scale, and uses stop‑gradient per‑class rescaling to restore zero‑mean balance, achieving comparable or better performance on math and search benchmarks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI
Sep 4

Spurious Advantage Hidden in GRPO

Group Relative Policy Optimization (GRPO) assigns a magnitude to each rollout based on within‑group reward statistics, rewarding rollouts that reach the correct answer through reasoning. However, the same magnitude can be high for rollouts that reach the answer by guessing, creating a spurious advantage that misleads the policy toward guess‑like behaviors. The paper identifies three scenarios where this occurs—bounded‑answer tasks, open‑answer sets with bounded sub‑cases, and search agents with many paths to the same answer—and proposes SIGNBALANCE, a composition‑free magnitude that preserves the verifier sign, uses a global scale, and restores zero‑mean balance via stop‑gradient per‑class rescaling, matching GRPO on open‑answer math and improving on bounded‑answer math and search agents.

By Jiamian Wang, Samyadeep Basu, Koustava Goswami, Tong Yu, Zhiqiang Tao
arXiv Machine Learning
Aug 24

Reinforcing Multi-Turn Reasoning in LLM Agents via Fine-Grained Reward Structure and Credit Assignment

The paper explores how dense, turn-level reward structures can improve reinforcement learning for large language model agents in multi-turn tasks. It introduces three reward granularity types—terminal, delayed, and per-turn—and adapts Group Relative Policy Optimization and Proximal Policy Optimization to each. Experiments on search and game agents show that per-turn rewards consistently yield better training dynamics, faster convergence, and higher answer correctness compared to sparse terminal or delayed rewards.

By Quan Wei, Siliang Zeng, Chenliang Li, Zhongruo Wang, William Brown, Oana Frunza, Wei Deng, Anderson Schneider, Yuriy Nevmyvaka, Yang Katie Zhao, Alfredo Garcia, Mingyi Hong