← Back to all news
arXiv Machine Learning By Duy Anh Nguyen

Does Continued Pretraining on a Learner Corpus Improve Automated Essay Scoring on English Proficiency Tests? Evidence from EFCAMDAT

Read the original on arXiv Machine Learning →

The study examines whether domain‑adaptive continued pretraining (DAPT) on a learner‑writing corpus (EFCAMDAT) can enhance transformer‑based automated essay scoring (AES) for English proficiency tests. Researchers applied DAPT to BERT, RoBERTa, and DistilBERT and compared the adapted models with their original checkpoints on the FCE and IELTS datasets, evaluating both in‑domain scoring and few‑shot cross‑dataset transfer. Results show that full‑corpus DAPT yields mixed effects, while proficiency‑specific DAPT often outperforms full‑corpus DAPT and sometimes even the non‑adapted baseline, though benefits vary by proficiency composition and encoder architecture and do not consistently transfer across tests.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
3d ago

Text as an Index for Zero-Shot Cross-Domain Knowledge Tracing

The paper introduces TIZSKT, a zero‑shot cross‑domain knowledge tracing model that separates behavioral sequence modeling from domain‑local historical evidence construction. It uses text as an index via a frozen text encoder and unsupervised per‑domain projection to build question addresses, then aggregates a student’s past outcomes into a question‑specific historical correctness summary. Experiments on three public datasets show that TIZSKT outperforms baselines in mean AUC and accuracy, with ablations confirming the importance of text addressing and cross‑segment continuation.

By Yin Yi, Haiping Ma, Siyu Song, Ziwen Wang, Shangshang Yang
rag
More like this →
arXiv AI
Sep 24

Evaluation of pre-trained models for pedagogical assessment of novel AI-assisted educational questions

The study evaluates how well pre‑trained models can classify the Bloom level of AI‑generated educational questions, a task that is crucial for ensuring pedagogical quality. Traditional machine‑learning models perform poorly on out‑of‑distribution data, whereas transformer and large‑language models achieve higher accuracy, especially after feature‑engineering techniques such as text splicing and appending learning objectives. Retraining the models yields the most significant performance gains across all datasets.

By Michael Lawrence Castanares, Princess Ventures, Allan Tan
llmsnlp
More like this →