arXiv Machine Learning By Unggi Lee, Haeun Park

Can a System-One LLM Perform Knowledge Tracing When Few or No Learners Are Logged?

Read the original on arXiv Machine Learning →

The paper investigates whether an off‑the‑shelf System‑One large language model (LLM) can perform knowledge tracing (KT) when few or no learners are logged. On seven datasets, the model—named Jev—achieves a mean AUC of .706 without any target platform data, outperforming 28 deep KT models trained on eight learners and a System‑Two Thinking‑KT approach. Adding a few logged examples and a similar‑learner statistic (JevKT) further improves performance to .722, maintaining superiority over deep KT up to 64 learners and surpassing supervised KT until 128 learners.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 30

Mnemon: Raw Records, Fast Judgments, Slow Thoughts

Mnemon is a memory agent that stores conversations as raw, dated records and uses a fast System 1 decision model (Jev) to quickly judge the relevance of records, while a slow System 2 LLM plans searches and composes answers. The agent consolidates records into topic timelines and value histories in the background, enabling efficient retrieval without rewriting conversations into structured formats. Experiments show Mnemon achieving high scores on LoCoMo and LongMemEval‑S with low context length and cost, and Jev outperforming LLMs in evidence separation and speed.

By Guangren Wang
arXiv Computation and Language
Sep 2

Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall

arXiv:2609.01532v1 Announce Type: new Abstract: Logit-based knowledge distillation (KD) is used to train smaller language models (LMs) via supervision from stronger teachers, but whether its benefits...

By Jacqueline He, Howard Yen, Shuyue Stella Li, Margaret Li, Hanqing Zeng, Yinglong Xia, Benyu Zhang, Zhuokai Zhao, Qiang Zhang, Pang Wei Koh, Luke Zettlemoyer, Wen-tau Yih