arXiv Machine Learning
Aug 27

Emergent Abilities in Large Language Models: A Survey

Emergent Abilities in Large Language Models: A Survey reviews how scaling LLMs leads to previously unseen capabilities such as advanced reasoning, in-context learning, coding, and problem-solving. The paper critically examines definitions, inconsistencies, and the conditions that foster these abilities, including scaling laws, task complexity, pre‑training loss, quantization, and prompting strategies. It also discusses the extension to Large Reasoning Models and highlights safety concerns like deception, manipulation, and reward hacking, calling for improved evaluation and governance.

By Leonardo Berti, Flavio Giorgi, Gjergji Kasneci
arXiv AI
Sep 16

Self-Emergence Agent Architecture:Behavior-Inertia HMM, Reflexive Metacognition,and Social-Contrastive Self-Modeling

The paper introduces the Self‑Emergence Agent Architecture (SEAA), a framework that combines a Hidden Markov Model for behavioral inertia, a reflexive metacognition loop that updates the HMM, and a social environment where agents compare behaviors. This closed loop enables agents to develop distinct, stable personalities and social structures without external prompts. Experiments with both a language‑model‑free prototype and hosted LLMs demonstrate spontaneous symmetry breaking and the emergence of consensus hubs and outliers.

By Xiaoyang Liu