arXiv AI

An Educator-Guided LLM Pedagogical Agent for Scaffolded Feedback in Conceptual Database Design

The paper introduces an educator‑guided large language model (LLM) pedagogical agent that provides scaffolded feedback for conceptual database design. Embedded in an entity–relationship diagram editor, the system bases its feedback on the student’s artifact, assignment requirements, educator‑authored rubrics, and instructional resources, using a four‑stage workflow that progresses from concept checks to low‑detail feedback and localized clarification. In a deployment across three ERD environments with 383 feedback episodes, 71.1% of target‑level changes incorporated the hidden diagnostic target, and qualitative analysis highlighted the benefits and challenges of staged disclosure.

arXiv AI
Sep 21

On the Limitations of Large Language Models for Conceptual Database Modeling

The article examines how Large Language Models can aid in creating Entity-Relationship diagrams from natural language requirements. It tests three LLMs with three prompting strategies—Zero-Shot, Chain of Thought, and Chain of Thought + Verifier—on scenarios of increasing complexity. Findings show that while LLMs perform adequately on simpler tasks, their reliability drops with more complex requirements, leading to inconsistencies, ambiguities, and constraint representation failures.

By Arthur F. Siqueira, Carlos D. S. Nogueira, Eduarda Farias, Claudio E. C. Campelo, J\'ulia Menezes
arXiv AI
3d ago

RegulaTutor: A Theory-Informed Framework for Long-Term Personalized Learning

RegulaTutor is a theory-informed framework for long‑term personalized tutoring that links a learner’s historical evidence to instructional support. Guided by self‑regulated learning research, it uses a cognitive, affective, metacognitive, and motivational (CAMM) framework to derive evidence‑supported learner interpretations and teaching policies that are updated as new observations arrive. The framework includes PairRoute, an offline refinement procedure that distinguishes harness, model, and mixed failures, proposes targeted harness revisions, and constructs stage‑level supervision for confirmed model failures, improving historical‑evidence accuracy, learner diagnosis, and teaching quality across evaluated model configurations.

By Yonggang Li, Boqian Han, Rui Sheng, Yushi Sun, Zixin Chen
arXiv AI
Sep 24

Evaluating Feedback Focus and Pedagogical Adaptivity in LLM-Generated Feedback on Student Writing

The paper examines whether state‑of‑the‑art large language models (LLMs) produce feedback that aligns with expert teachers’ pedagogical practices, focusing on feedback type and adaptivity. Using a refined taxonomy of seven feedback focus types, the authors annotate and compare teacher and LLM‑generated feedback from three university writing courses, creating the FeedType benchmark. Their analysis shows that while most LLMs cover many feedback types, they do not match teachers’ distribution patterns or adaptive behavior across draft stages and student performance levels.

By Norah Almousa, Shayan Peyghambari Oskoui, Raquel Coelho, Gayle Rogers, Xiang Lorraine Li, Diane Litman
arXiv AI
Oct 1

Examining Variation in How Guided AI Tutors Resolve Student Impasses

The study analyzes 20,462 student turns from 1,260 sessions with a guided LLM chemistry tutor, identifying 6,630 impasse turns categorized as conceptual errors, expressed uncertainty, or help‑seeking. Three tutoring conditions—baseline, no‑direct‑answer, and guided—were simulated, revealing that the baseline tutor often gave direct answers, the no‑direct‑answer tutor always asked follow‑up questions, and the guided tutor varied its responses based on context. Impasse trajectories showed that each additional impasse turn reduced the likelihood of recovery, while addressing errors became increasingly beneficial compared to repeated scripted questioning.

By Bakhtawar Ahtisham, Kirk Vanacore, Alessandra Napoli, Josh Arens, Ksenia Ionova, Clayton Cohn, Shima Salehi, Rene Kizilcec