Google AI Blog

Social learning: Collaborative learning with large language models

Posted by Amirkeivan Mohtashami, Research Intern, and Florian Hartmann, Software Engineer, Google Research Large language models (LLMs) have significantly improved the state of the art for solving tasks specified using natural language, often reaching performance close to that of people. As these models increasingly enable assistive agents, it could be beneficial for them to learn effectively from each other, much like people do in social settings, which would allow LLM-based agents to improve each other’s performance.

Google AI Blog
Mar 14, 2024

Cappy: Outperforming and boosting large multi-task language models with a small scorer

Posted by Yun Zhu and Lijuan Liu, Software Engineers, Google Research Large language model (LLM) advancements have led to a new paradigm that unifies various natural language processing (NLP) tasks within an instruction-following framework. This paradigm is exemplified by recent multi-task LLMs, such as T0 , FLAN , and OPT-IML .

By Google AI
arXiv AI
Jun 16

Lect\=uraAgents: A Multi-Agent Framework for Adaptive Personalized AI-Assisted Learning and Embodied Teaching

arXiv:2606. 16428v1 Announce Type: cross Abstract: Effective personalized AI-assisted learning demands systems that can not only generate accurate learner-specific educational materials, but also dynamically adapt their instruction to diverse learners.

By Jaward Sesay, Yue Yu, Siwei Dong, Yemin Shi, Guangyao Chen, B\"orje F. Karlsson
arXiv AI
Aug 18

When State Becomes an Attack Surface: State-Semantic Injection in LLM-Driven Embodied Agents

arXiv:2608. 16806v1 Announce Type: cross Abstract: Large Language Models (LLMs) have demonstrated capabilities in in-context learning, task decomposition, step-by-step reasoning, and code generation, driving their gradual evolution from text generation models into the core of agents capable of perceiving environments, invoking tools, and executing tasks.

By Jiawei Liu, Jiacheng Guo, Tian Zhang, Yiwei Xu, Juan Wang, Jinlin Fan, Bowen Xiao, Chi Guo, Keyan Guo, Hongxin Hu
arXiv AI
Sep 12

Some hypotheses on how chatbots work in problem-solution-driven conversations: Large Language Models as confirmation of the Innovation Illusion

The article examines chatbots as partners in problem‑solving conversations, arguing that basic chatbots—comprising a large language model (LLM) and a simple interface—are multifaceted but cannot match human cognitive flexibility. Drawing on Aggregation Dynamics, Cognitive Linguistics, Neuropsychology, and Psychology, the authors describe how LLMs encode artificial metaphorical problem propagations from training data, which only partially imitate human thinking. They conclude that further LLM development will not yield true thinking partners, yet chatbots are widely used, making their understanding socially and politically important.

By S. F. M. van Vlijmen, H. D. Lethe jr
arXiv Computation and Language
Sep 21

CoLearn: An Agentic Tutor that Learns its Learner in a Human--AI Co-Learning Loop

CoLearn is an interactive, agentic tutoring system that learns about each learner through a persistent memory of mastery and misconceptions, updated with a Bayesian Knowledge Tracing model that uses a large language model as an observation function. It generates personalized questions targeting the learner’s weakest topics and recurring misconceptions, and provides a live evidence view for progress visualization and blind A/B comparison. In blind A/B tests, learners preferred questions conditioned on this memory 68‑69% of the time, and simulations show the agent’s belief converges toward the learner’s true mastery.

By Kailai He, Zhihao Wu, Linhai Zhang, Runcong Zhao, Yulan He, Jiazheng Li
Google AI Blog
Mar 11, 2024

Chain-of-table: Evolving tables in the reasoning chain for table understanding

Posted by Zilong Wang, Student Researcher, and Chen-Yu Lee, Research Scientist, Cloud AI Team People use tables every day to organize and interpret complex information in a structured, easily accessible format. Due to the ubiquity of such tables, reasoning over tabular data has long been a central topic in natural language processing (NLP).

By Google AI