arXiv Computation and Language By Andres Karjus

Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turn

Read the original on arXiv Computation and Language →

The chapter discusses how large language models (LLMs) simplify the transformation of cultural material into analyzable variables and how LLM-driven agentic systems broaden machine assistance across research workflows. It examines key aspects of this emerging paradigm and its broader implications, arguing that LLMs increase scale, methodological diversity, and delegation while largely preserving the fundamental logic that underpins cultural measurement and claim formation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Hugging Face Trending Papers
Oct 9

Agentic Large Language Models

The article discusses the rise of large language models (LLMs) and their growing influence on our decisions and actions. It explores the concept of agentic LLMs—LLMs that can act directly in the real world and interact with one another. The book aims to explain how these agentic LLMs function, their capabilities, and the implications for users.

arXiv AI
Sep 3

Accurate in space, unreliable in time: how LLMs represent national cultural change

The paper investigates how large language models (LLMs) represent national cultural change over time, using more than two decades of World Values Survey data and the Inglehart‑Welzel cultural map. It finds that while LLMs generally place countries near their most recent surveyed positions, their representations lag behind current data, under‑capture the magnitude of change, introduce spurious movements, and rarely reproduce trajectory reversals. These temporal inaccuracies reveal a flattening effect that limits the models’ cultural awareness and raises concerns for evaluation, representational harms, and governance of culturally aware AI systems.

By Yalda Daryani, Miranda Bogen, Madeleine I. G. Daepp
arXiv Computation and Language
3d ago

LLMs Infer Cultural Context but Fail to Apply It When Responding

The paper introduces CAPRI, a dataset of conversations designed to test whether large language models (LLMs) can adapt their responses to users’ cultural backgrounds. Experiments show that while LLMs can infer a user’s cultural context and recall relevant conventions, they frequently fail to apply this knowledge when generating answers unless explicitly prompted to do so. The study also finds that LLMs’ cultural adaptations improve as more cues are provided, yet their default priors are not culture‑neutral and sometimes reflect the model’s country of origin.

By Yisong Miao, Jian Zhu, Vered Shwartz
arXiv AI
Sep 2

WorldBench: Culturally Grounded Benchmark for Multilingual Agents

WorldBench is a new multilingual benchmark that tests large language model agents on culturally grounded everyday workflows, offering 1,600 tasks in seven languages and eight cultures. The benchmark evaluates agents through structured sandbox actions and introduces Constrained Task Success (CTS), a metric that assesses task completion, minimal modification, and other complementary aspects via deterministic and LLM-as-a-Judge evaluations. Experiments show that even leading models achieve only 49.2% CTS, revealing significant gaps in correctness and state preservation across languages and cultures.

By Leonardo Ranaldi, Sherrie Shen, Jushi Kai, Alexandra Birch