arXiv AI By Jiawei Zhou, Kritika Venkatachalam, Minje Choi, Koustuv Saha, Munmun De Choudhury

Communication styles and reader preferences of LLM- and human-authored COVID-19 information explanations: a case study

Read the original on arXiv AI →

The study compares communication styles of large language models (LLMs) and humans in explaining COVID‑19 misinformation, using a dataset of 1,498 fact‑checking claims and 99 blinded reader evaluations. LLM‑generated explanations scored lower on persuasive strategies, certainty, and alignment with social values, yet over 60% of participants preferred LLM content for clarity, completeness, and persuasiveness. The findings suggest that reader preference may not align with traditional measures of communication quality, highlighting both the promise and limits of LLMs in health communication.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jun 9

Testing the Black Box: Structural Barriers to Independent Evaluation of Consumer-Facing Health LLMs

arXiv:2606. 08483v1 Announce Type: new Abstract: Background: Consumer-facing large language models are now a common source of health information, and they interpret and personalize responses rather than retrieve them.

By Rahul Gorijavolu, Kaushik Madapati, Pritika Vig, Rawan Abulibdeh, Nikhil Jaiswal, Mahri Kadyrova, Zeamanuel Hailu Tesfaye, Charles Senteio, Paula Maurutto, Leo Anthony Celi
arXiv Computation and Language
Sep 22

ReLay: Personalized LLM-Generated Plain-Language Summaries for Better Understanding, but at What Cost?

arXiv:2605.00468v2 Announce Type: replace Abstract: Plain Language Summaries (PLS) aim to make research accessible to lay readers, but they are typically written in a one-size-fits-all style that ign...

By Joey Chan, Yikun Han, Jingyuan Chen, Samuel Fang, Lauren D. Gryboski, Alexandra Lee, Sheel Tanna, Qingqing Zhu, Zhiyong Lu, Lucy Lu Wang, Yue Guo
Hugging Face Trending Papers
Jun 21

Confident but Conflicted: Internal Uncertainty and Cognitive Dissonance Resolution in LLMs

Large language models (LLMs) frequently encounter inputs that disagree with their prior outputs, through user pushback, retrieved documents, or web search results. While the way they resolve such conflicts -- a process we frame as cognitive dissonance resolution -- has been characterized behaviorally, its connection to internal model uncertainty is not well understood.

arXiv AI
Sep 17

From 'May' to 'Is': Certainty Distortion in Language Model Rewriting

The study examines how language models (LMs) alter the expressed certainty of statements when rewriting text, a process termed certainty distortion. Using an LM‑based metric aligned with human judgments, the authors find that up to 75% of LM outputs exhibit such distortion, with most models more likely to inflate certainty than reduce it. Repeated paraphrasing can amplify this effect, especially in medical contexts, and while prompt interventions help, they do not fully eliminate the bias.

By Catarina G Belem, Shang Wu, Hongyu Yao, Mark Steyvers, Sameer Singh, Padhraic Smyth
arXiv Machine Learning
Sep 2

A Multi-Branch Feature Fusion Approach for Health Misinformation Detection and Propagation

This paper introduces a multi‑branch fusion framework that combines transformer‑based semantics, rhetorical cues, stance representations, and psychologically motivated proxies to detect health misinformation and characterize its spread on online social networks. The authors propose an interpretable Cognitive Propagation Score (CPS) derived from text cues that estimate argument complexity, emotional intensity, and virality potential, aiding diffusion‑risk reasoning when engagement data are missing. Experiments on three benchmark datasets (Constraint, COVID‑19_FNIR, Monkeypox) demonstrate near‑perfect classification and ranking performance, with ablation studies showing complementary gains from psychological and rhetorical components.

By Mkululi Sikosana, Sean Maudsley-Barton, Oluwaseun Ajao