arXiv AI

AI-Moderated Interviews for Market Research and Digital Twins Calibration

AI‑moderated interviews are a scalable market‑research method that can match human moderation in depth, cover more themes, and recover more customer needs while keeping budgets constant. Participants, however, feel more emotionally engaged with live humans. Digital twins built from AI‑moderated data predict consumer responses better than demographics‑only personas, but the added richness does not improve quantitative predictions over static interviews, and prediction errors stem from differences in thinking styles and data‑distribution gaps.

arXiv AI
Jun 4

Synthetic Personalities: How Well Can LLMs Mimic Individual Respondents Using Socio-Economic Microdata?

arXiv:2606. 04592v1 Announce Type: cross Abstract: LLM-based digital twins promise to scale and accelerate market research, but most published twins are either coarse persona bots conditioned on a few demographic questions or detailed individual-level twins built on purpose-collected surveys and interview transcripts.

By Leonard Kinzinger, Jochen Hartmann
arXiv AI
Sep 15

Synthetic Data in Marketing Research: How to Evaluate and When to Trust

The paper discusses the use of synthetic data in marketing research, arguing that the key question is not whether synthetic respondents work, but when they do. It categorizes synthetic data into three types—ungrounded LLM responses, segment-level personas, and individual-level digital twins—and maps each to the decisions they can support. The authors also propose a taxonomy of accuracy measures, highlight the forgotten question problem, and introduce an ex‑ante answerability diagnostic based on R² to improve twin-human correlation.

By Oded Netzer, Rajan Sambandam
arXiv AI
Jul 31

Large-Scale ChatBot Validation Through Customer Digital Twin Simulations

arXiv:2607. 26060v1 Announce Type: cross Abstract: LLM-based chatbots are transforming customer service in regulated domains such as banking, but scalable and cost-effective validation remains a critical barrier to safe deployment.

By Cristovao Iglesias, Devesh Batra, Alankar Atreya, Stefan Wagner, Robert Hankache, Patrick Sinclair, Giulio Pelosio, Michael McMillan, Greig A. Cowan, Raad Khraishi
arXiv AI
Aug 24

ExploraTwin, a Non-Profit Research Platform for Digital Twin Simulations

ExploraTwin is an open‑access, non‑profit research platform designed to lower the friction for testing and deploying digital twin simulations. It offers two modes: a survey mode that lets researchers upload or create surveys, select digital twin samples, run simulations, and export analysis‑ready data; and a panel mode that supports small groups of twins for open‑ended conversations, annotation, and moderated voice discussions. The platform also introduced CroissantTwin, a standardized data format for adding twin samples, and demonstrated high fidelity in survey execution with 99.6% valid responses across 197,000 answer units.

By Naveen Venkatanarayanan, Yuchen Qiu, Tianyi Peng, George Gui, Olivier Toubia
arXiv AI
Jun 16

AI systems out-persuade expert humans

arXiv:2606. 16475v1 Announce Type: cross Abstract: Many societal decisions are settled by contests of persuasion.

By Kobi Hackenburg, Caroline Wagner, Luke Hewitt, Ben M. Tappin, Ed Saunders, Hannah Rose Kirk, Helen Margetts, Christopher Summerfield
arXiv AI
Sep 4

Human Psychometric Questionnaires Mischaracterize LLM Behavior

The paper investigates whether human psychometric questionnaires can reliably characterize large language models (LLMs) in everyday interactions. By comparing eight open‑source LLMs’ value and personality profiles from Likert self‑reports (PVQ‑40/21 and BFI‑44/10) with generation probabilities on value‑laden user queries, the authors find substantial divergence between the two methods. The study shows that questionnaire items contain explicit lexical cues that lead models to respond in socially desirable ways, whereas realistic user queries lack such cues, and demographic persona prompts shift questionnaire responses but not generation outputs, indicating that questionnaire scores overestimate LLMs’ true behavioral tendencies.

By Woojung Song, Dongmin Choi, Yoonah Park, Jongwook Han, Eun-Ju Lee, Yohan Jo