arXiv:2609.23573v1 Announce Type: new
Abstract: Synthetic essays can help reduce dependence on human-written data in Automated Essay Scoring (AES). However, they often lack realistic errors, limiting...
By Duy Anh Nguyen
arXiv:2606. 10327v1 Announce Type: cross Abstract: Automated Essay Scoring (AES) systems must judge interdependent discourse elements (e.
By Ali Keramati, Mark Warschauer
The paper introduces a cost‑aware framework that treats each prompt type as an arm in a multi‑armed bandit controller, enabling adaptive selection of optimal prompting strategies during inference for automated essay scoring. Experiments on IELTS Writing Task 2 essays demonstrate that this bandit-driven approach achieves comparable scoring accuracy to exhaustive grid search while reducing LLM calls by 78.4%. The study also presents the first cost‑reliability learning curves for essay scoring, offering actionable insights for educational technology platforms balancing operational costs against assessment validity.
By Olga Manakina, Igor Bogdanov
arXiv:2607. 19219v1 Announce Type: cross Abstract: Large language models (LLMs) have been widely applied to automated essay scoring (AES) and automated feedback generation (AFG).
By Xuefeng Jin, Jiashuo Zhang, Teng Cao, Bin Yang
The study examines whether domain‑adaptive continued pretraining (DAPT) on a learner‑writing corpus (EFCAMDAT) can enhance transformer‑based automated essay scoring (AES) for English proficiency tests. Researchers applied DAPT to BERT, RoBERTa, and DistilBERT and compared the adapted models with their original checkpoints on the FCE and IELTS datasets, evaluating both in‑domain scoring and few‑shot cross‑dataset transfer. Results show that full‑corpus DAPT yields mixed effects, while proficiency‑specific DAPT often outperforms full‑corpus DAPT and sometimes even the non‑adapted baseline, though benefits vary by proficiency composition and encoder architecture and do not consistently transfer across tests.
By Duy Anh Nguyen
arXiv:2606. 20152v1 Announce Type: cross Abstract: Recent advances in Large Language Models (LLMs) have substantially transformed Automated Essay Scoring (AES), yet the internal mechanisms underlying LLM-based scoring remain poorly understood.
By Jiaxu Zuo, Mu You, Kaixin Lan, Tao Fang, Yujia Huo, Henghua Shen, Lidia S. Chao, Derek F. Wong
Large language models (LLMs) have been widely applied to automated essay scoring (AES) and automated feedback generation (AFG). However, existing studies rely primarily on prompt engineering or supervised fine-tuning, while systematic research on reinforcement learning (RL) post-training and automated evaluation of feedback quality remains limited.
arXiv:2609.14795v1 Announce Type: cross
Abstract: There is a tradeoff in machine translation meta-evaluation between prioritizing alignment with adequacy versus fluency. The balance depends on the co...
By Behzad Shayegh, Niloofar Kazemi
arXiv:2607. 15829v1 Announce Type: cross Abstract: Automated essay scoring (AES) enables scalable assessment and timely feedback but remains challenged by transformer input-length limitations, which can cause information loss when processing long essays.
By Haowei Hua
arXiv:2608.29948v1 Announce Type: new
Abstract: Evaluating data-text alignment remains challenging: existing metrics often provide limited explanations for the scores, while prompt-based LLM-as-Judge...
By Kun Efimov-Zhang, Yifei Song, Claire Gardent
The paper introduces Trait-Aware Policy Optimization (TAPO), a post‑training framework for autoregressive models that score essays across multiple traits. TAPO decomposes rewards by sample and trait, integrating global consistency, trait accuracy, format validity, and inter‑trait dependencies, while enriching prompts with trait descriptions. Experiments on various backbone models show TAPO consistently outperforms supervised fine‑tuning and scalar‑reward baselines, proving its effectiveness and transferability for multi‑trait essay scoring.
By Zhengyang Wang, Sanwoo Lee, Jiaxin Wang, Chenxi Miao, Weikang Li, Yunfang Wu
The paper introduces HiFTS, a unified autoregressive framework that generates hierarchical chain-of-thought (CoT) feedback before predicting trait-level and holistic scores for multi-trait automated essay scoring. HiFTS distills rubric-grounded CoT feedback from a teacher large language model and trains student models to jointly produce feedback and scores, employing Group Relative Policy Optimization to balance score agreement, calibration, feedback quality, and structural validity. The authors also present CFMS-34, a new Chinese multi-trait AES dataset, and demonstrate that HiFTS achieves strong scoring performance while producing coherent, rubric-aligned feedback on CFMS-34 and ASAP++.
By Shihang Yang, Sanwoo Lee, Ningning Zhao, Yunfang Wu