As AI agents are increasingly deployed in complex environments, understanding their behaviors becomes critical. Yet behavioral scientific research on AI agents remains manual and labor-intensive.
arXiv:2608. 10030v1 Announce Type: new Abstract: As AI agents are increasingly deployed in complex environments, understanding their behaviors becomes critical.
By Soo Yong Lee, Jongha Lee, Jaewan Chun, Hyunjin Hwang, Fanchen Bu, Ziv Ben-Zion, Taekwan Kim, Denny Borsboom, Jaemin Yoo, Kijung Shin
The article discusses how machine learning exercises can be designed for automated assessment tools, framing them as deterministic input-output tasks. It emphasizes that this approach does not create a new grading system but enables existing platforms (e.g., VPL for Moodle, Codeforces, MOJ) to support AI education more effectively. The authors argue that integrating theory with practice through such exercises can foster dynamic, interactive AI courses.
By Artur Jordao
arXiv:2507.12674v3 Announce Type: replace-cross
Abstract: Evaluating Artificial Intelligence (AI) tutor feedback before deployment requires anticipating student engagement, typically assessed through...
By Rose Niousha, Mihran Miroyan, Abigail O'Neill, Joseph E. Gonzalez, Gireeja Ranade, John DeNero, Narges Norouzi
MIT Schwarzman College of Computing launched a pilot program that hosted a weeklong summer workshop for higher education faculty. The workshop focused on exploring how AI and machine learning materials can be adapted for use in their classrooms across various disciplines.
By Amanda Diehl | MIT Schwarzman College of Computing
StudentSim is a research system developed by Microsoft Research that simulates how students interact with AI tutoring tools. It allows researchers to evaluate and refine tutor performance before deploying them to real learners. The system covers multiple subjects, including chess, writing, and mathematics, and provides feedback to improve tutoring effectiveness.
By Ke Yang, Chenglong Wang, Michel Galley, Jeevana Priya Inala, ChengXiang Zhai, Jianfeng Gao
arXiv:2608. 13940v1 Announce Type: new Abstract: AI research agents (AIRA) can now propose, implement, and evaluate their own machine learning experiments, but progress on frontier tasks is throttled by cost: a candidate solution can be written in minutes, whereas evaluating it can take hours to days of GPU time.
By Thomas Simon Foster, Bassel Al Omari, Tingchen Fu, Thomas Mann, Carl Domond, Lucia Cipolina-Kun, Bhavul Gauri, Muna Aghamelu, Alexander D. Goldie, Eryk Helenowski, Jean-Christophe Gagnon-Audet, Alberto Pepe, Saba Nazir, Daniel Izcovich, Noam Levi, Rishi Hazra, Karen Hambardzumyan, Nicolas Baldwin, Xian Li, Martin Josifoski, Paris Giampouras, Masoud Jalili Sabet, Anya Sims, Hela Momand, Tatiana Shavrina, Despoina Magka, Jason Weston, Yulin Wang, Anirudh Goyal, Jo\~ao Henriques, Yoram Bachrach, Emily McMilin, Jakob Nicolaus Foerster
SAIL is an open model with 35 B total and 3 B active parameters designed for literature research, scientific coding, and multi‑step research workflows. It is developed through a science‑aware improvement loop in which agents built on frontier AI models analyze task failures, create training tasks to address capability gaps, and iterate this process across multiple development cycles. The training pipeline combines supervised fine‑tuning, specialist training, multi‑teacher on‑policy distillation, and agentic reinforcement learning, enabling SAIL to achieve competitive performance on scientific research tasks with fewer parameters than leading open‑weight models.
By SAIL Model Team, Boyuan Sun, Bryan Dai, Che Liu, Chi Liu, Derek Li, Hongming Piao, Mengzhuo Chen, Xidong Wang, Yan Shu, Yinda Chen, Ziyang Zeng
Last week we hosted over a hundred and fifty AI practitioners in our offices for our first self-organizing conference on machine learning.
arXiv:2607. 21306v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as tutors and thought partners, helping users reason through problems.
By Verona Teo, Raghav Jain, Tobias Gerstenberg, Max Kleiman-Weiner
arXiv:2606. 11215v1 Announce Type: cross Abstract: Large Language Model (LLM) usage in recent years has become increasingly widespread in the Artificial Intelligence in Education (AIED) community.
By Sabrina C. Eimler, Lukas Erle, Daniel Flood, Aditi Haiman, Luca H\"ackert, Andr\'e Helgert, Lachlan McGinness, B\"usra Yapici
arXiv:2606. 16842v1 Announce Type: cross Abstract: Teaching Software Engineering for AI-enabled systems entails addressing the integration of AI components within full-scale software architectures under realistic constraints.
By Amir Mashmool, Kishan Ravindra Sawant, Mojtaba Shahin, Nico Hochgeschwender, Rainer Koschke