arXiv AI By Canh Thien Dang, An Nguyen

Verified, not generated: expert-verified AI study materials and the distribution of learning gains in a university course

Read the original on arXiv AI →

The study examined the impact of expert‑verified AI‑generated study materials on first‑year university economics students. In a two‑cohort difference‑in‑differences design, half of the 170 students received podcasts, FAQs, and quiz‑based guides that were produced by a source‑grounded model and checked by a graduate teaching assistant. The intervention produced a 2.34‑mark advantage on a 50‑mark component, reduced the share of marks below the upper‑second classification boundary by 24.7 percentage points, and had the largest gains for students in the bottom quintile. Interviews with 36 students suggested that the verification label encouraged engagement while preserving critical scrutiny of the AI output.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 17

The Uneven Impact of Generative AI on Student Learning: Examining the Roles of Reliance, Evaluation Literacy, and Course Policy in AI-related Courses

The study investigates how generative AI (GenAI) affects student learning in AI-related courses, using survey data from 118 students across 12 courses. Four distinct user clusters were identified—high-use, light-use, and two moderate-use groups—each showing varying benefits and reliance patterns. The research highlights that early reliance, evaluation literacy, and instructor policies significantly influence perceived academic benefits and negative impacts, underscoring the need for institutional policies to address inequities in AI use.

By Lydia Manikonda, Mei Si, Sirajam Munira, Oshani Seneviratne, Kristin Bennett
arXiv AI
Sep 21

Reducing Barriers to Academic Support: Evaluating a Course-Specific RAG System for Addressing Help-Seeking Disparities in Higher Education

The paper introduces Beacon, a course‑specific Retrieval‑Augmented Generation (RAG) system that offers private, module‑aligned academic support to students. By grounding responses in approved teaching materials, Beacon aims to lower barriers to help‑seeking and encourage independent learning, especially in computing education where tasks are cumulative and demanding. Evaluation through questionnaires and interviews showed students found Beacon’s responses trustworthy and closely aligned with course content, viewing it as a useful first point of support before consulting lecturers or official resources.

By Andy Gray, Jake Hobbs
arXiv AI
Aug 14

Assessment Design in the GenAI Era: The X1-X2-X3 Assessment Pattern for Testing Students' AI Literacy, Learning Outcomes, and Reflection

arXiv:2608. 12351v1 Announce Type: cross Abstract: Generative artificial intelligence (GenAI) has challenged the validity of unsupervised online assessment, especially in technical subjects where plausible answers can be produced with little effort.

By Riasat Islam (School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom), Thomas Roelleke (School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom)