arXiv AI

Quantifying Perception-Based Student Success with Generative AI: An Exploratory Monte Carlo Simulation

arXiv:2507. 01062v4 Announce Type: replace-cross Abstract: Generative artificial intelligence (GenAI) tools such as ChatGPT have attracted growing attention in higher education, particularly in relation to how students perceive their usefulness, usability, and educational value.

arXiv AI
Sep 4

A Prompt-Engineering Approach to Develop Scalable, Flexible, and Real-Time Hybrid Micro-Level Personalization in a General Purpose AI Teaching Assistant

The paper introduces a prompt‑engineering framework that personalizes large language model (LLM) teaching assistants across disciplines by tailoring responses to six learner‑specific dimensions, creating 96 distinct learner profiles. It also analyzes student queries through Bloom’s Taxonomy to gauge cognitive complexity, encoding both learner attributes and cognitive assessments into structured prompts that condition the LLM without retraining. Experiments using NLP metrics and a small human study demonstrate that this approach yields perceptible differences in response style and structure, with statistical evidence linking specific learner attributes to measurable changes.

By Saptarshi Basu, Sandeep Kakar, Ashok Goel
arXiv AI
Sep 17

The Uneven Impact of Generative AI on Student Learning: Examining the Roles of Reliance, Evaluation Literacy, and Course Policy in AI-related Courses

The study investigates how generative AI (GenAI) affects student learning in AI-related courses, using survey data from 118 students across 12 courses. Four distinct user clusters were identified—high-use, light-use, and two moderate-use groups—each showing varying benefits and reliance patterns. The research highlights that early reliance, evaluation literacy, and instructor policies significantly influence perceived academic benefits and negative impacts, underscoring the need for institutional policies to address inequities in AI use.

By Lydia Manikonda, Mei Si, Sirajam Munira, Oshani Seneviratne, Kristin Bennett
arXiv AI
Aug 14

Assessment Design in the GenAI Era: The X1-X2-X3 Assessment Pattern for Testing Students' AI Literacy, Learning Outcomes, and Reflection

arXiv:2608. 12351v1 Announce Type: cross Abstract: Generative artificial intelligence (GenAI) has challenged the validity of unsupervised online assessment, especially in technical subjects where plausible answers can be produced with little effort.

By Riasat Islam (School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom), Thomas Roelleke (School of Electronic Engineering and Computer Science, Queen Mary University of London, London, United Kingdom)