arXiv AI

GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions

arXiv Machine Learning
Aug 27

Emergent Abilities in Large Language Models: A Survey

Emergent Abilities in Large Language Models: A Survey reviews how scaling LLMs leads to previously unseen capabilities such as advanced reasoning, in-context learning, coding, and problem-solving. The paper critically examines definitions, inconsistencies, and the conditions that foster these abilities, including scaling laws, task complexity, pre‑training loss, quantization, and prompting strategies. It also discusses the extension to Large Reasoning Models and highlights safety concerns like deception, manipulation, and reward hacking, calling for improved evaluation and governance.

By Leonardo Berti, Flavio Giorgi, Gjergji Kasneci
arXiv AI
Sep 16

Self-Emergence Agent Architecture:Behavior-Inertia HMM, Reflexive Metacognition,and Social-Contrastive Self-Modeling

The paper introduces the Self‑Emergence Agent Architecture (SEAA), a framework that combines a Hidden Markov Model for behavioral inertia, a reflexive metacognition loop that updates the HMM, and a social environment where agents compare behaviors. This closed loop enables agents to develop distinct, stable personalities and social structures without external prompts. Experiments with both a language‑model‑free prototype and hosted LLMs demonstrate spontaneous symmetry breaking and the emergence of consensus hubs and outliers.

By Xiaoyang Liu
arXiv AI
Jun 9

Payoff scaling shapes cooperation in LLM agents across languages

arXiv:2601. 19082v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed as autonomous agents that negotiate, coordinate, and act on behalf of users.

By Trung-Kiet Huynh, Dao-Sy Duy-Minh, Thanh-Bang Cao, Phong-Hao Le, Hong-Dan Nguyen, Phu-Quy Nguyen-Lam, Minh-Luan Nguyen-Vo, Hong-Phat Pham, Phu-Hoa Pham, Thien-Kim Than, Chi-Nguyen Tran, Huy Tran, Gia-Thoai Tran-Le, Alessio Buscemi, Le Hong Trang, The Anh Han
arXiv Computation and Language
Oct 22

Linguistic Productivity in Large Language Models: Models Coerce, but do not Preempt

The paper investigates how large language models (LLMs) handle two usage‑based grammatical strategies: coercion, where a mismatched word is reinterpreted to fit its context, and preemption, where a plausible structure is avoided because it never appears in expected contexts. Experiments across models of varying sizes show that larger LLMs successfully recognize and produce constructional productivity in coercive situations, even with novel words, but they fail to exhibit preemptive behavior, lacking the negative evidence that would guide avoidance of unconventional but semantically viable constructions. The authors argue that coercion is detectable due to its surprising, semantically motivated nature, whereas preemption lacks such a signature, leading to an asymmetry where models coerce but do not preempt.

By Claire Bonial, Claire Benet Post, Laura Michaelis, Harish Tayyar Madabushi
arXiv Computation and Language
Sep 18

Factors Influencing the Emergence of Dependency Length Minimization in Neural Agent Simulations

The study explores how neural agents develop dependency length minimization (DLM) in artificial languages using a recurrent neural network framework. By manipulating processing constraints such as listening noise, speaker capacity, and incremental sentence processing, the researchers find that DLM emerges only under incremental processing pressure, while other factors produce varied word‑order preferences. These results suggest that human cognitive processing limits may influence the emergence of DLM in language.

By Yuqing Zhang, Tessa Verhoef, Gertjan van Noord, Arianna Bisazza