arXiv AI

The Emergence of Social Science of Large Language Models

arXiv AI
3d ago

Mapping the Emerging Social Science of Large Language Models

The paper maps the nascent social‑science literature on large language models (LLMs) by analysing 198 curated papers and 47,719 field‑scale papers. It identifies three main domains—LLM as Social Minds, LLM Societies, and LLM‑Human Interactions—each containing 13 subcategories such as reasoning, bias, collective intelligence, and trust. The taxonomy is validated through clustering stability, author classification agreement, and topic mapping, revealing differing prominence across conference and journal venues.

By Yi Yang, Xiao Jia, Zeyun Dong, Chenzhang Wang, Zhanzhan Zhao
arXiv AI
Aug 28

Toward a New Science of AI as Cognitive Infrastructure

The paper proposes a new interdisciplinary field called Cognitive Infrastructure Studies (CIS) to examine how AI systems act as invisible, foundational cognitive infrastructures that shape what people can know and do in digital societies. It argues that these infrastructures, through anticipatory personalization and adaptive invisibility, automate relevance judgments and shift epistemic agency to non‑human systems. CIS offers methodological tools, such as infrastructure breakdown experiments, to uncover the hidden cognitive dependencies created by AI preprocessing across individual, collective, and societal levels.

By Giuseppe Riva
arXiv Computation and Language
2d ago

The PIMMUR Principles: Ensuring Validity in Collective Behavior of LLM Societies

The study audits 576 LLM-based social simulations from 350 papers using the PIMMUR framework, which evaluates agent profile, interaction, memory, minimal control, unawareness, and realism. Results show that PIMMUR principles are met more often than minimal control, unawareness, and realism, with frontier LLMs correctly identifying the underlying experiment in 65.2% of cases and half of prompts pre‑determining outcomes. Reproducing five experiments revealed that many reported collective phenomena disappear or reverse when PIMMUR principles are enforced, suggesting that apparent emergent behaviors may be methodological artifacts rather than genuine social dynamics.

By Jiaxu Zhou, Jen-tse Huang, Xuhui Zhou, Man Ho Lam, Xintao Wang, Hao Zhu, Wenxuan Wang, Maarten Sap