arXiv Computation and Language

Co-Linguistics: AI-augmented Theory Construction in Linguistics

arXiv Machine Learning
Aug 27

Emergent Abilities in Large Language Models: A Survey

Emergent Abilities in Large Language Models: A Survey reviews how scaling LLMs leads to previously unseen capabilities such as advanced reasoning, in-context learning, coding, and problem-solving. The paper critically examines definitions, inconsistencies, and the conditions that foster these abilities, including scaling laws, task complexity, pre‑training loss, quantization, and prompting strategies. It also discusses the extension to Large Reasoning Models and highlights safety concerns like deception, manipulation, and reward hacking, calling for improved evaluation and governance.

By Leonardo Berti, Flavio Giorgi, Gjergji Kasneci
arXiv Computation and Language
Aug 27

A Primer on Computational Semantics for Artificial Intelligence Systems

The article "A Primer on Computational Semantics for Artificial Intelligence Systems" introduces the importance of understanding how transformer-based language models learn and represent meaning as they become more widely used. It surveys linguistic meaning from scientific and philosophical perspectives, outlines three main semantic theories—formal, grounded, and distributional—and compares these theories to how humans acquire language.

By Casey Kennington
arXiv Computation and Language
Sep 23

A retrospective analysis on the use of LLMs to study infant syntax learning

The paper reviews how large language models (LLMs) are employed to study infant syntax acquisition, focusing on the BabyLM challenge that aims for human‑level syntactic performance using developmentally realistic corpora. It critically examines dataset construction, model selection, training procedures, and syntactic evaluation methods, highlighting methodological assumptions that limit the theoretical reach of these studies. The authors find that using developmentally realistic corpora has only modest impact on benchmark performance, pointing to fundamental computational differences between LLMs and actual infant syntax learners.

By H\'elie Bazin (SCAI, SND, ISIR), Anouk Barberousse (SND), Fran\c{c}ois Yvon (MLIA)
arXiv AI
Sep 12

Some hypotheses on how chatbots work in problem-solution-driven conversations: Large Language Models as confirmation of the Innovation Illusion

The article examines chatbots as partners in problem‑solving conversations, arguing that basic chatbots—comprising a large language model (LLM) and a simple interface—are multifaceted but cannot match human cognitive flexibility. Drawing on Aggregation Dynamics, Cognitive Linguistics, Neuropsychology, and Psychology, the authors describe how LLMs encode artificial metaphorical problem propagations from training data, which only partially imitate human thinking. They conclude that further LLM development will not yield true thinking partners, yet chatbots are widely used, making their understanding socially and politically important.

By S. F. M. van Vlijmen, H. D. Lethe jr