arXiv Machine Learning By Vikrant Sahu, Khethavath Sunil Naik, Gagan Raj Gupta

MARS: A Momentum-Aware Adaptive Rating System for Personalized Assessment

Read the original on arXiv Machine Learning →

MARS is a Momentum‑Aware Adaptive Rating System that models a question bank as a directed weighted knowledge graph and updates learner proficiency using dynamic rating sensitivity, response quality, and momentum‑aware learner velocity. It introduces a time‑budgeted mark‑maximization objective to select questions within a fixed test duration under negative marking. Experiments on ASSISTments 2009 and MARS‑SimExam show that MARS delivers smoother rating updates than Fixed Elo and achieves the highest score under time‑budgeted negative‑marking routing, improving total score by 8.09 over the strongest baseline and reducing overtime violations from 50% to 5.6%.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Aug 26

Learning to Grade Efficiently: A Bandit-Driven Prompt-Selection Framework for Low-Cost LLM Essay Scoring

The paper introduces a cost‑aware framework that treats each prompt type as an arm in a multi‑armed bandit controller, enabling adaptive selection of optimal prompting strategies during inference for automated essay scoring. Experiments on IELTS Writing Task 2 essays demonstrate that this bandit-driven approach achieves comparable scoring accuracy to exhaustive grid search while reducing LLM calls by 78.4%. The study also presents the first cost‑reliability learning curves for essay scoring, offering actionable insights for educational technology platforms balancing operational costs against assessment validity.

By Olga Manakina, Igor Bogdanov
arXiv Computation and Language
Sep 17

PersonaPath: Towards Knowledge-Centric Personalized Learning Path Planning

PersonaPath is a new benchmark for knowledge‑centric personalized learning path planning, pairing 2,000 learner personas with a hierarchical knowledge graph of 347 textbooks, 1,751 units, and 4,092 concepts across 77 subjects. The study evaluates large language models on this benchmark, finding that even the best model achieves only a 29.5% final pass rate in Basic Education and fails to exceed 44.7% in tailoring paths to individual learners, highlighting a significant adaptivity gap. This work underscores the challenge of moving beyond exercise‑centric recommendation toward goal‑oriented, curriculum‑scale guidance.

By Yu Liu, Zeming Liu, Tianle Zhang, Zihao Cheng, Yuhang Guo, Kehai Chen, Min Zhang, Yunhong Wang, Haifeng Wang
arXiv Machine Learning
5d ago

Text as an Index for Zero-Shot Cross-Domain Knowledge Tracing

The paper introduces TIZSKT, a zero‑shot cross‑domain knowledge tracing model that separates behavioral sequence modeling from domain‑local historical evidence construction. It uses text as an index via a frozen text encoder and unsupervised per‑domain projection to build question addresses, then aggregates a student’s past outcomes into a question‑specific historical correctness summary. Experiments on three public datasets show that TIZSKT outperforms baselines in mean AUC and accuracy, with ablations confirming the importance of text addressing and cross‑segment continuation.

By Yin Yi, Haiping Ma, Siyu Song, Ziwen Wang, Shangshang Yang
Hugging Face Trending Papers
Jul 21

Beyond Score Prediction: LLM-Based Essay Scoring and Feedback Generation via Reinforcement Learning with Rubric Rewards

Large language models (LLMs) have been widely applied to automated essay scoring (AES) and automated feedback generation (AFG). However, existing studies rely primarily on prompt engineering or supervised fine-tuning, while systematic research on reinforcement learning (RL) post-training and automated evaluation of feedback quality remains limited.

Hugging Face Trending Papers
Oct 13

Rubrics from the Task, Verdicts from Evidence: Pointwise Rubric Rewards with Tool-Augmented Judges

The paper introduces ReVeR, a pointwise rubric reward model that derives hard rules and graded principles directly from instructions, avoiding response-induced bias. It employs tool-augmented judges and label‑blind distillation to create ReVeR‑Traces, a large dataset of rubric reasoning and judging trajectories. Experiments show ReVeR surpasses pairwise rubric models in preference accuracy, especially for instruction following, and reveal that higher preference accuracy does not always lead to better downstream policies.