arXiv AI July 7, 2026 By Wisdom Ikezogwo, Mehmet Saygin Seyfioglu, Ranjay Krishna, Karim Bouyarmane

When Rubrics Fail: Error Enumeration as Reward in Reference-Free RL Post-Training for Virtual Try-On

arXiv:2603. 05659v3 Announce Type: replace-cross Abstract: Reinforcement learning with verifiable rewards (RLVR) and Rubrics as Rewards (RaR) have driven strong gains in domains with clear correctness signals and even in subjective domains by synthesizing evaluation criteria from ideal reference answers.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning

Sep 16

ImpossibleRubrics: Stress-Testing Generated Rubrics as Reward Signals

The paper introduces ImpossibleRubrics, a benchmark of 169 impossible tasks designed to test the robustness of language‑model‑generated rubrics as reward signals. Each task is paired with a verifiable oracle certificate that defines what constitutes an honest answer, and the benchmark includes 48 answerable controls. Experiments show that many rubric generators are exploited frequently—up to 36% on a stress cut—highlighting a significant gap in rubric quality rather than task difficulty, and that generic rubrics can be more vulnerable than tailored ones.

By Bowen Qin, Yi Xie, Yesheng Liu, Xi Yang

llms reinforcement-learning benchmarks safety

arXiv Computation and Language

Sep 1

Small Language Models as Judges for Rubric-Based Reinforcement Learning

arXiv:2608.30005v1 Announce Type: new Abstract: Rubric-based reinforcement learning extends RL beyond tasks with exact answers or rule-based verifiers by scoring responses against instance-specific c...

By Fengyu Xie, Yilun Zhao, Bingsen Chen, Arman Cohan, Chen Zhao

llms reinforcement-learning

arXiv Machine Learning

Sep 22

RLVR$^{2}$: Reinforcement Learning with Verifiable Rubric-based Ranking

arXiv:2609.23457v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) is expanding from tasks with well-defined correctness signals, such as mathematics and code, towa...

By Hao Li, Zhengkun Zhang, Gangqiang Hu, Zhen Zhang, Yude Gao, Dai Dai, Jing Liu

reinforcement-learning benchmarks

arXiv AI

Aug 11

Autorubric: A Unifying Framework for Rubric-Based LLM Evaluation on Non-Verifiable Tasks

arXiv:2603. 00077v3 Announce Type: replace-cross Abstract: Rubric-based LLM judges have become indispensable for evaluating and optimizing systems on non-verifiable tasks, where success cannot be reduced to exact programmatic checks.

By Delip Rao, Chris Callison-Burch

llms agents reinforcement-learning benchmarks safety

arXiv Machine Learning

Sep 2

Where the Verifier Fails: A Category-Level Audit of Reward Signals in RLVR

arXiv:2609.01354v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) and standard benchmark evaluation both rely on an automatic verifier that turns a free text ans...

By Esther Xin

reinforcement-learning benchmarks

Hugging Face Trending Papers

Sep 20

RLVR$^{2}$: Reinforcement Learning with Verifiable Rubric-based Ranking

Reinforcement Learning with Verifiable Rewards (RLVR) is expanding from tasks with well-defined correctness signals, such as mathematics and code, toward multifaceted quality requirements specified by...

reinforcement-learning benchmarks

One email a morning, machine-written

Related stories

ImpossibleRubrics: Stress-Testing Generated Rubrics as Reward Signals

Small Language Models as Judges for Rubric-Based Reinforcement Learning

RLVR$^{2}$: Reinforcement Learning with Verifiable Rubric-based Ranking

Autorubric: A Unifying Framework for Rubric-Based LLM Evaluation on Non-Verifiable Tasks

Where the Verifier Fails: A Category-Level Audit of Reward Signals in RLVR

RLVR$^{2}$: Reinforcement Learning with Verifiable Rubric-based Ranking