arXiv AI
Oct 19

Validating LLM-generated political networks with survey-reported partisan exposure

The study evaluates large language models (LLMs) that generate political networks by comparing them to survey-reported partisan exposure from the ANES 2020–2022 Social Media Study. It finds that while network structure and political assortativity vary across model configurations, many models either over‑separate Democratic and Republican egos or underestimate Republican exposure, leading to group‑specific errors in local partisan environments. These discrepancies persist even among networks with similar aggregate properties, indicating that aggregate metrics alone can mask important individual‑level inaccuracies.

By Marco Tonin, Michele Tizzoni, Bruno Lepri, Luca Maria Aiello
arXiv AI
5d ago

GenAI as an 'Invisible Hand' in Opinion Dynamics: Evidence from a Group-Level Simulation Study

The study examines how generative AI (genAI) can subtly influence collective opinion dynamics by acting as an 'invisible hand.' Using a large-scale simulation of 50,000 group discussions on 50 controversial statements with three large language models (LLMs), the researchers varied LLM agreeableness and personalization to assess their impact in homogeneous versus heterogeneous groups. Results show that profile-specific personalization boosts LLM influence when the model takes a non-neutral stance, while neutral LLMs exert a stronger effect in homogeneous groups, leading to hypotheses on the joint role of AI features and social configurations in shaping collective opinions.

By Thomas Grisold, Johannes Schneider