arXiv AI

Enhancing knowledge tracing robustness for new question cold start in Intelligent Tutoring Systems

The paper introduces Practical Integrated Cross-consistent Knowledge Tracing (PICKT), a model that incorporates multiple feature types to improve Knowledge Tracing robustness when new questions lack interaction history. It evaluates the impact of difficulty, textual, and knowledge‑map relational features, finding that difficulty is especially informative for hard questions, while fused text and map features help estimate unseen questions by leveraging similar ones seen during training. The study concludes that prioritizing feature annotation aligned with educational service characteristics is essential for maintaining robust diagnostics in Intelligent Tutoring Systems.

arXiv AI
5d ago

Interpretable Difficulty-Aware Knowledge Tracing in Tutor-Student Dialogues

The paper introduces an interpretable, difficulty-aware knowledge tracing framework for tutor‑student dialogues that leverages large language models. It explicitly models student ability and question difficulty at each turn, using the original question text and the next tutor‑posed task to estimate knowledge state. By integrating Item Response Theory, the framework translates LLM outputs into cognitive‑theory‑based parameters, achieving superior performance over existing baselines while producing interpretable predictions.

By Shuyan Huang, Alexander Scarlatos, Jaewook Lee, Andrew Lan
arXiv AI
Sep 10

Tracing Mathematical Proficiency Through Problem-Solving Processes

The paper introduces Knowledge Tracing Leveraging Problem‑Solving Process (KT‑PSP), a method that incorporates students’ problem‑solving steps to model mathematical proficiency more comprehensively than traditional knowledge tracing. It presents the KT‑PSP‑25 dataset and a new framework, StatusKT, which uses a teacher‑student‑teacher LLM pipeline to extract proficiency indicators, generate responses, and evaluate mastery. Experiments show that StatusKT improves prediction accuracy and offers interpretable explanations by explicitly modeling proficiency.

By Jungyang Park, Suho Kang, Jaewoo Park, Jaehong Kim, Jaewoo Shin, Seonjoon Park, Youngjae Yu
arXiv AI
Oct 27

Embedding-Based Educational Taxonomies

The paper explores using semantic text embeddings to automatically build educational taxonomies by clustering math question embeddings. It compares these embedding‑based taxonomies to existing Common Core State Standards (CCSS) taxonomies in two ASSISTments datasets, finding substantial but incomplete overlap. When applied to Deep Knowledge Tracing, the new taxonomies improve predictive performance by about 3‑5 AUC percentage points.

By Kia Karbasi, Kaveh Karbasi, Gregory Pottie
arXiv Machine Learning
3d ago

Text as an Index for Zero-Shot Cross-Domain Knowledge Tracing

The paper introduces TIZSKT, a zero‑shot cross‑domain knowledge tracing model that separates behavioral sequence modeling from domain‑local historical evidence construction. It uses text as an index via a frozen text encoder and unsupervised per‑domain projection to build question addresses, then aggregates a student’s past outcomes into a question‑specific historical correctness summary. Experiments on three public datasets show that TIZSKT outperforms baselines in mean AUC and accuracy, with ablations confirming the importance of text addressing and cross‑segment continuation.

By Yin Yi, Haiping Ma, Siyu Song, Ziwen Wang, Shangshang Yang
arXiv Computation and Language
Oct 7

Agreement Is Not Validity: Cross-Model LLM Consensus in Diagnosing Student Failure Modes in K-12 Math Tutoring Dialogue

arXiv:2610.08703v1 Announce Type: new Abstract: In K-12 mathematics tutoring, student-tutor dialogue provides rich evidence of learners' problem-solving processes and sources of difficulty. Learning...

By Clayton Cohn, Joyce Fonteles, Kirk Vanacore, Gianni Mazza, Candida Crawford, Tom Hooper, Gautam Biswas, Rene Kizilcec
arXiv AI
Oct 28

What Improves During Pretraining? Tracking Knowledge Acquisition with Point-in-Time Models

The paper investigates how language models acquire knowledge over the course of pretraining by using point-in-time models trained on web snapshots from different years. It introduces a temporal variability score (TVS) that measures how consistently a knowledge item is represented across these snapshots. The study finds that items with high TVS improve more rapidly later in training and outperform low‑TVS items in most benchmark settings, especially on knowledge‑intensive tasks.

By Chang Su, Bin Wu, Emine Yilmaz, Yao Lu