← Back to all news
arXiv Computation and Language By Jihao Zhao, Shuaishuai Zu, Zhiyuan Ji, Chunlai Zhou, Biao Qin

Writer-R1: Dynamic Rubric Mining for Reinforcement Learning of Open-Ended Writing

Read the original on arXiv Computation and Language →

Writer‑R1 is a writing training pipeline that uses Inductive Rubric Generation (IRG) to automatically construct prompt‑specific rubrics for open‑ended writing tasks. The pipeline expands an open writing corpus, applies the generated rubrics during supervised training and reinforcement learning, and provides the rubrics to writers before generation. A compact model, RubricGen‑4B, can supply rubrics for new requests, and Writer‑R1 improves WritingBench and HelloBench scores over 4B and 8B backbones.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Related stories

Hugging Face Trending Papers
Jul 21

Beyond Score Prediction: LLM-Based Essay Scoring and Feedback Generation via Reinforcement Learning with Rubric Rewards

Large language models (LLMs) have been widely applied to automated essay scoring (AES) and automated feedback generation (AFG). However, existing studies rely primarily on prompt engineering or supervised fine-tuning, while systematic research on reinforcement learning (RL) post-training and automated evaluation of feedback quality remains limited.

llmsreinforcement-learningfine-tuningbenchmarks
More like this →
arXiv Computation and Language
Oct 9

EvoRubric: Self-Evolving Rubric-Driven RL for Open-Ended Generation

EvoRubric introduces a co‑evolutionary reinforcement learning framework that learns rubric‑driven evaluation criteria for open‑ended text generation. The system uses a shared policy that simultaneously generates responses and rubrics, while a frozen meta‑verifier and grader provide validity checks and scoring. Experiments on medical, writing, and science benchmarks show that EvoRubric outperforms static and other evolving‑rubric baselines, achieving higher average scores on five tasks.

By Xin Guan, Xiaomeng Hu, Shen Huang, Zhenyi Wang, Bo Zhang, Zijian Li, Pengjun Xie, Bo Liu, Jiuxin Cao
llmsreinforcement-learningbenchmarks
More like this →
arXiv AI
Oct 5

OPD Before RL: Warm-Starting Rubric-Based RL with On-Policy Distillation

The paper introduces a two‑stage training framework for rubric‑based reinforcement learning (RL) that first uses rubric‑privileged on‑policy distillation (RP‑OPD) to provide dense token‑level supervision, then applies RL to optimize the rubric reward. In RP‑OPD, a student model learns to match a rubric‑aware teacher’s next‑token distributions on student‑generated prefixes. Experiments on HealthBench, ResearchQA, and RubricHub Science show that this two‑stage approach yields the highest scores and reduces reward hacking compared to a standard SFT + RL baseline.

By Xinpeng Wang, Wei Shi, Yu-Chia Chen, Maria Zontak, Yun He, Richard Yuanzhe Pang
reinforcement-learningfine-tuningefficiency
More like this →