arXiv AI

How do machines learn? Evaluating the AIcon2abs method

arXiv:2401. 07386v5 Announce Type: cross Abstract: This study expands on previous work that introduced the AIcon2abs method (AI from Concrete to Abstract: Demystifying Artificial Intelligence to the general public), an innovative approach designed to increase public understanding of machine learning (ML) across diverse age groups, including K-12 students, and aims to evaluate its effectiveness.

arXiv AI
Sep 3

Addressing Trust in AI Systems through Education: A Didactic Perspective

The paper introduces ICE-T, a didactic framework designed to improve trust in AI systems through education. It combines intermodal transfer, computational thinking, and explanatory thinking to address the opacity of machine learning tools. By linking these facets to research on algorithm aversion and AI literacy, the authors argue that trust calibration should be an explicit educational goal.

By Pierre Haritz, Hendrik Krone, Thomas Liebig
Hugging Face Trending Papers
Sep 2

Addressing Trust in AI Systems through Education: A Didactic Perspective

The paper identifies two main challenges in machine learning education: opaque tools that give learners only a superficial grasp of ML and hinder the development of calibrated trust in AI systems. It introduces ICE‑T, a didactic framework that combines intermodal transfer, computational thinking, and explanatory thinking to provide representational richness, graduated process control, and error contextualization. By linking these facets to trust‑calibration literature, the authors argue that trust should be an explicit educational goal and that ICE‑T offers a scalable method to achieve it.

arXiv Machine Learning
Sep 14

Simulating Disengaged Students to Evaluate LLM-based Tutors

The paper introduces Disengagement-Aware Student Simulators (DAS2), a protocol that models five learner-engagement states—engaged, gaming, wheel-spinning, off-task, and mixed—to evaluate AI tutor performance before deployment. Using annotated tutoring sessions from ASSISTments09, DAS2’s rule-based labels matched human consensus in 81% of cases, and conditioning simulations on intended states narrowed the correctness-rate gap between simulated and authentic sessions for gaming and wheel-spinning behaviors. The study also compares five AI tutors across these states, finding stable relative rankings but state-specific performance differences, and notes that automated evaluation does not fully align with human judgment.

By Xianghui Meng, Jionghao Lin
arXiv AI
Aug 28

TutorTrace: A Dataset and Taxonomy for Classifying Learner Behavioral States during AI-Assisted Programming Education

TutorTrace is a new dataset and behavioral abstraction pipeline that captures learners’ low‑level IDE telemetry to make their behavioral context visible and computable in real time. The dataset, collected across 480 students in two introductory Python courses, includes 180 K telemetry events, 13 633 behavioral segments, and 27 continuously computed metrics, and it underpins a taxonomy of learner activity before, between, and after AI queries. Preliminary classroom tests show that behavior‑aware prompts reduce the time between queries, and the system can predict upcoming queries with AUROC scores of .726 and .717 on two held‑out tasks.

By David Barron, Xiaohang Tang, Rezky Dwisantika, Minsun Kim, David H. Smith IV, Jiaming Cui, Yan Chen