arXiv Machine Learning

SWIM: Student Writing Simulation via Proficiency-Conditioned Generation

The paper introduces SWIM, a task that frames student writing simulation as proficiency‑conditioned essay generation. It evaluates prompting, supervised fine‑tuning, and reinforcement learning for aligning generated essays with student proficiency profiles, using automated essay scoring as a metric. Results show that prompting alone offers limited control, while supervised fine‑tuning and reinforcement learning significantly improve alignment across content, lexical, grammatical, and organizational traits, though low‑proficiency writing remains difficult to replicate.

arXiv AI
Aug 26

Learning to Grade Efficiently: A Bandit-Driven Prompt-Selection Framework for Low-Cost LLM Essay Scoring

The paper introduces a cost‑aware framework that treats each prompt type as an arm in a multi‑armed bandit controller, enabling adaptive selection of optimal prompting strategies during inference for automated essay scoring. Experiments on IELTS Writing Task 2 essays demonstrate that this bandit-driven approach achieves comparable scoring accuracy to exhaustive grid search while reducing LLM calls by 78.4%. The study also presents the first cost‑reliability learning curves for essay scoring, offering actionable insights for educational technology platforms balancing operational costs against assessment validity.

By Olga Manakina, Igor Bogdanov
arXiv Computation and Language
Oct 16

Writer-R1: Dynamic Rubric Mining for Reinforcement Learning of Open-Ended Writing

Writer‑R1 is a writing training pipeline that uses Inductive Rubric Generation (IRG) to automatically construct prompt‑specific rubrics for open‑ended writing tasks. The pipeline expands an open writing corpus, applies the generated rubrics during supervised training and reinforcement learning, and provides the rubrics to writers before generation. A compact model, RubricGen‑4B, can supply rubrics for new requests, and Writer‑R1 improves WritingBench and HelloBench scores over 4B and 8B backbones.

By Jihao Zhao, Shuaishuai Zu, Zhiyuan Ji, Chunlai Zhou, Biao Qin
Hugging Face Trending Papers
Jul 21

Beyond Score Prediction: LLM-Based Essay Scoring and Feedback Generation via Reinforcement Learning with Rubric Rewards

Large language models (LLMs) have been widely applied to automated essay scoring (AES) and automated feedback generation (AFG). However, existing studies rely primarily on prompt engineering or supervised fine-tuning, while systematic research on reinforcement learning (RL) post-training and automated evaluation of feedback quality remains limited.

arXiv Computation and Language
Sep 7

Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring

The paper introduces Trait-Aware Policy Optimization (TAPO), a post‑training framework for autoregressive models that score essays across multiple traits. TAPO decomposes rewards by sample and trait, integrating global consistency, trait accuracy, format validity, and inter‑trait dependencies, while enriching prompts with trait descriptions. Experiments on various backbone models show TAPO consistently outperforms supervised fine‑tuning and scalar‑reward baselines, proving its effectiveness and transferability for multi‑trait essay scoring.

By Zhengyang Wang, Sanwoo Lee, Jiaxin Wang, Chenxi Miao, Weikang Li, Yunfang Wu