arXiv Machine Learning

RegKT: Interpretable and Robust Deep Knowledge Tracing With IRT-Regularizer

RegKT introduces an IRT‑regularizer to deep knowledge tracing models, aiming to improve both interpretability and robustness. The paper argues that while deep learning has boosted accuracy, it has reduced explainability and increased overfitting, especially on small educational datasets. By adding this regularization, RegKT seeks to make deep knowledge tracing more suitable for real‑world educational applications.

arXiv Machine Learning
Jun 30

MOSAIC: Orchestrating Collaborative Knowledge Tracing with Hierarchical Semantic Alignment

arXiv:2606. 29049v1 Announce Type: new Abstract: Knowledge Tracing (KT) is important for personalized education but traditionally suffers from two key limitations: a reliance on shallow ID-based representations that neglect semantic depth and a restriction to single-granularity mastery estimation that overlooks hierarchical knowledge dependencies.

By Xinjin Li, Mengyue Wang, Yuzhen Lin, Pengbin Feng, Ziqi Sha, Yeyang Zhou, Yu Ma
arXiv Machine Learning
Aug 5

UNVaMP: Neural Knowledge Tracing with Variational Regularization of Latent Knowledge Dynamics

arXiv:2608. 03811v1 Announce Type: new Abstract: We introduce the Unified Neural Variational Measurement of Proficiency (UNVaMP) architecture, a knowledge tracing method that integrates observed student-item interactions with internal memory to produce evolving latent representations of student knowledge.

By Carson J. Cook, Ahmed J. Zerouali, Anthony Schmidt, Reginald Ziedzor, Paul Lin, Luke G. Eglington
arXiv Computation and Language
Sep 1

ACTD: Anchor-Based Cross-Tokenizer Distillation with Residual Regularization

The paper introduces ACTD, an Anchor-Based Cross-Tokenizer Distillation method that aligns vocabularies and sequences to transfer reasoning capabilities from large language models to smaller students. It uses a novel anchor loss with residual regularization to reduce alignment noise and extends the approach to multiple teachers. Experiments on five reasoning benchmarks with three teachers show state‑of‑the‑art results, with the multi‑teacher variant outperforming existing baselines.

By Huiyi Zhang, Zijian Li, Xiaocheng Feng, Weitao Ma, Xiaoliang Yang, Yichong Huang, Bing Qin
arXiv AI
Oct 31

Interpretable Difficulty-Aware Knowledge Tracing in Tutor-Student Dialogues

The paper introduces an interpretable, difficulty-aware knowledge tracing framework for tutor‑student dialogues that leverages large language models. It explicitly models student ability and question difficulty at each turn, using the original question text and the next tutor‑posed task to estimate knowledge state. By integrating Item Response Theory, the framework translates LLM outputs into cognitive‑theory‑based parameters, achieving superior performance over existing baselines while producing interpretable predictions.

By Shuyan Huang, Alexander Scarlatos, Jaewook Lee, Andrew Lan
arXiv AI
Aug 26

Too much of a good thing -- when knowledge distillation promotes overfitting, and how to avoid it

The paper investigates how knowledge distillation (KD) applied at intermediate layers of a neural network can affect overfitting and model performance. While traditional KD focuses on the final output, this study explores block‑wise KD across eleven datasets, finding that on standard datasets the last block suffices, but on fine‑grained, data‑scarce settings intermediate supervision significantly improves accuracy. The authors also analyze optimal supervision granularity using attention maps, Centered Kernel Alignment, and Grad‑CAM, and examine teacher‑student fine‑tuning strategies.

By Irene Trigueros-Lorca, Leonardo Concepci\'on, Christian Wagner, Isaac Triguero, Daniel Molina
arXiv AI
Sep 17

Enhancing knowledge tracing robustness for new question cold start in Intelligent Tutoring Systems

The paper introduces Practical Integrated Cross-consistent Knowledge Tracing (PICKT), a model that incorporates multiple feature types to improve Knowledge Tracing robustness when new questions lack interaction history. It evaluates the impact of difficulty, textual, and knowledge‑map relational features, finding that difficulty is especially informative for hard questions, while fused text and map features help estimate unseen questions by leveraging similar ones seen during training. The study concludes that prioritizing feature annotation aligned with educational service characteristics is essential for maintaining robust diagnostics in Intelligent Tutoring Systems.

By Wonbeen Lee, Channyoung Lee, Junho Sohn, Hansam Cho