arXiv Computation and Language

VoteGEO-Bench: Measuring the Impact of Generative Engine Optimization on Electoral Visibility

VoteGEO-Bench is a benchmark that examines how generative engine optimization (GEO) affects the visibility of election-related web content in large language model responses. It covers the 2024 U.S. presidential election and the 2026 Japanese House of Representatives election, using election queries, historical webpages, and voter personas. The study evaluates 11 rewriting strategies, finding that target‑specified rewrites and those that improve page organization or strengthen arguments increase exposure more than other tactics, while partisan identities can create larger baseline exposure gaps than a single rewritten page.

arXiv AI
2d ago

Validating LLM-generated political networks with survey-reported partisan exposure

The study evaluates large language models (LLMs) that generate political networks by comparing them to survey-reported partisan exposure from the ANES 2020–2022 Social Media Study. It finds that while network structure and political assortativity vary across model configurations, many models either over‑separate Democratic and Republican egos or underestimate Republican exposure, leading to group‑specific errors in local partisan environments. These discrepancies persist even among networks with similar aggregate properties, indicating that aggregate metrics alone can mask important individual‑level inaccuracies.

By Marco Tonin, Michele Tizzoni, Bruno Lepri, Luca Maria Aiello
arXiv AI
Sep 4

Toward Collective-Centric Evaluation of Preference Inference for Participatory Democracy

The paper examines how Preference Inference (PI) models used in large-scale participatory democracy platforms can alter the perceived consensus and minority support by predicting missing votes. It introduces a collective‑centric evaluation framework that assesses whether inferred votes maintain key properties of the overall preference landscape, rather than focusing solely on individual prediction accuracy. Using the largest multilingual dataset to date—four consultations with over 90,000 participants, 1 million votes, and 22 languages—the study finds that models with similar predictive accuracy can differ markedly in how well they preserve the collective structure, underscoring that accuracy alone is insufficient for evaluating PI in democratic contexts.

By Pierre-Antoine Lequeu, Salim Hafid, Paul Lerner, Nazanin Shafiabadi, Laur\`ene Cave, David Mas, Jean-Philippe Cointet, Benjamin Piwowarski, Fran\c{c}ois Yvon
arXiv Machine Learning
Sep 17

Making Political Text Scaling Comparable: Infrastructure and Hyperparameter Sensitivity for 17 Algorithms

The paper argues that computational text‑based ideal point estimation (CT‑IPE) methods should be viewed as configurable measurement pipelines rather than fixed estimators. It presents a large‑scale comparative experiment involving 17 CT‑IPE algorithms, 5,537 runs, and about 4.25 million left‑right position estimates, and describes shared infrastructure that enables joint execution of these heterogeneous methods. Sensitivity analyses reveal that most algorithms exhibit low hyperparameter sensitivity (ICC < .10), with any remaining sensitivity concentrated in a few key researcher choices such as the language or embedding model, seed keyword lists, and number of topics.

By Patrick Parschan
Hugging Face Trending Papers
Aug 12

Who Would You Vote For? Auditing Political Alignment in LLMs: An Italian Case-Study

As users increasingly turn to Large Language Models (LLMs) for information and advice on political matters, particularly during election periods, the political preferences expressed by these systems have become a matter of public interest. Prior research has shown that interactions with LLMs can influence users' political attitudes and choices, raising questions about how these models themselves evaluate political actors.