arXiv AI
Beyond Benchmarking: Scenario-Based Evaluation of Large Language Models for Personalized Learning
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 7
Evaluating and Improving Pedagogical Fit in LLM-Based AI Tutors with the Pedagogical Suitability Index
arXiv:2608. 05411v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as AI tutors, but a correct answer is not always a pedagogically appropriate one.
arXiv Machine Learning
Jun 8
Elmes*: Automated Construction of Fine-Grained Evaluation Rubrics for Large Language Models in Long-Tail Educational Scenarios
arXiv:2606. 06546v1 Announce Type: new Abstract: Evaluating large language models (LLMs) for education requires measuring how models teach, not only what they know.
arXiv AI
Jul 10
DeepTutor: Towards Agentic Personalized Tutoring
arXiv:2604. 26962v3 Announce Type: replace-cross Abstract: Education is one of the most promising real-world applications for Large Language Models (LLMs).
arXiv AI
Aug 5
TACT: Taxonomy-Aligned Post-Training for Pedagogically Adaptive English Tutoring
arXiv:2608. 03952v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to provide conversational practice for English-as-a-second-language (ESL) learners.
arXiv AI
1d ago
AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study
AI University (AI‑U) is a flexible framework that uses a fine‑tuned large language model (LLM) combined with retrieval‑augmented generation (RAG) and a reasoning synthesis model to produce style‑aligned responses from lecture videos, notes, and textbooks. In a graduate‑level finite‑element‑method (FEM) course, the authors created a pipeline to generate course‑grounded training data, fine‑tuned an open‑source LLM with Low‑Rank Adaptation (LoRA), and applied RAG‑based synthesis. Evaluation through cosine similarity, LLM‑based assessment, expert review, and user studies showed that the expert model outperformed the base model in alignment with course materials, with 86 % of test cases scoring higher and human users preferring the expert model roughly twice as often. whyItMatters":"The study demonstrates a practical method for building course‑specific learning assistants that improve alignment with instructional content, offering a template that can be extended across STEM fields."
arXiv AI
Jun 9
AI-Integrated Learning Management System for Middle School: A Longitudinal Study of Learning Outcomes Through High School and Beyond
arXiv:2606. 07544v1 Announce Type: cross Abstract: Middle school is a key window for building core academic skills and the learning routines students carry into later grades, yet many students still fall behind because help is often limited and comes too late, after they have already been stuck for a while.