arXiv Machine Learning
Aug 19

Which CS1 Students Will Fail? Identifying Digital Markers from Learning Analytics in Computer Systems and Architecture Using Weighted Academic Momentum and Interaction Logs

The study explores whether combining traditional and digital learning analytics can predict failure in a first‑year CS1 course. Using data from 284 students across four cohorts, the authors identified ten candidate factors and built a logistic regression model that achieved 74.7% accuracy and 0.742 macro F1, with 87% recall for failing students. Weighted academic momentum, basic demographics, and LMS activity emerged as the most predictive features, suggesting that simple digital markers can enable early‑warning systems by week five.

By Lighton Phiri, Mutune Chaibela, Ivy Chisha, David Pungwa, Danny Siabbaba, Bydon Simukoko
arXiv AI
Sep 17

The Uneven Impact of Generative AI on Student Learning: Examining the Roles of Reliance, Evaluation Literacy, and Course Policy in AI-related Courses

The study investigates how generative AI (GenAI) affects student learning in AI-related courses, using survey data from 118 students across 12 courses. Four distinct user clusters were identified—high-use, light-use, and two moderate-use groups—each showing varying benefits and reliance patterns. The research highlights that early reliance, evaluation literacy, and instructor policies significantly influence perceived academic benefits and negative impacts, underscoring the need for institutional policies to address inequities in AI use.

By Lydia Manikonda, Mei Si, Sirajam Munira, Oshani Seneviratne, Kristin Bennett
arXiv AI
Aug 26

Causal Modelling of Support Interventions for Student Competency Assessment

The paper proposes a structural causal modelling framework for student competency assessment, moving beyond traditional probabilistic models like item response theory. It introduces a protocol for constructing such models, emphasizing the explicit representation of interventions (e.g., hints) and counterfactual analysis. The authors illustrate the approach with data from an assessment of compulsory school students’ algorithmic skills.

By Francesca Mangili, Alessandro Antonucci, Rafael Caba\~nas