arXiv Computation and Language

Who Am I? History-Aware Profiles for Student Simulation in Tutoring Dialogues

arXiv Machine Learning
Sep 2

PEARL: Training Socratic Tutors with Pedagogically Aligned Reinforcement Learning

PEARL is a framework that trains Socratic tutoring agents using pedagogically aligned reinforcement learning. It introduces a controllable student simulator to model diverse cognitive states, a reward model that jointly evaluates pedagogical quality and correctness, and a stable multi‑objective RL approach to balance competing tutoring goals. Experiments demonstrate that PEARL competes with both open‑source tutoring systems and leading proprietary LLMs.

By Qikai Chang, Zhenrong Zhang, Linbo Chen, Pengfei Hu, Jianshu Zhang, Youhui Guo, Jun Du
arXiv AI
Aug 19

Effective Personalized AI Tutors via LLM-Guided Reinforcement Learning

The paper presents a tutoring platform that combines a generative AI chatbot with a reinforcement learning algorithm to adaptively sequence practice problems for students learning Python. In a five‑month field study across ten high schools, the adaptive sequencing improved unassisted final exam performance by 0.15 standard deviations, with mediation analysis indicating that higher engagement drove the gains. The study demonstrates that signals from student‑chatbot interactions can be leveraged to personalize and optimize learning at scale.

By Angel Tsai-Hsuan Chung, Botong Zhang, Ling-Chieh Kung, Hamsa Bastani, Osbert Bastani
arXiv Machine Learning
Sep 4

SWIM: Student Writing Simulation via Proficiency-Conditioned Generation

The paper introduces SWIM, a task that frames student writing simulation as proficiency‑conditioned essay generation. It evaluates prompting, supervised fine‑tuning, and reinforcement learning for aligning generated essays with student proficiency profiles, using automated essay scoring as a metric. Results show that prompting alone offers limited control, while supervised fine‑tuning and reinforcement learning significantly improve alignment across content, lexical, grammatical, and organizational traits, though low‑proficiency writing remains difficult to replicate.

By Heejin Do, Jakub Kontak, Mrinmaya Sachan
arXiv Computation and Language
5d ago

Learning User Representations to Improve Simulation Fidelity

The paper introduces UserRepGen-4B, a representation generator that creates natural-language user representations to condition user simulators for more faithful conversation simulation. By formulating a conversation reconstruction task and using hindsight distillation, the system learns to generate representations that improve simulation fidelity across 700 conversations from seven datasets. The improved representations also enhance diversity preservation and user distinction in unseen tasks.

By Shuhaib Mehri, Philippe Laban, Michel Galley, Dilek T\"ur, Jennifer Neville, Jianfeng Gao
arXiv Machine Learning
Sep 15

Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States

arXiv:2609.15972v1 Announce Type: cross Abstract: As language models become more capable, long-term collaboration in learning, reasoning, and decision-making calls for a deeper understanding of the p...

By Zixuan Wang, Yufan Zhou, Jinzhou Tang, Xinle Yu, Chengjun Wu, Lyumanshan Ye, Zhaoxiang Feng, Letian Peng, Adyasha Patra, Fan Bai, Enze Ma, Zhengding Hu, Jianyang Gu, Zhao Wang, Yufei Ding, Jingbo Shang, Tianmin Shu, Zhiting Hu, Zhen Wang