arXiv Computation and Language

Social bot detection in the age of ChatGPT: Challenges and opportunities

The article reviews the challenges and opportunities of detecting social bots amid the rise of advanced AI chatbots. It highlights gaps in current detection methods, especially regarding AI-generated conversations, and identifies emerging trends such as synthetic data generation, multimodal cross‑platform detection, low‑resource language support, and federated learning approaches. The authors propose these directions as promising avenues for future research.

arXiv Machine Learning
Sep 22

CSC: Calibrated Simplicity for Conflict-Aware Social Bot Detection in the LLM Era

The paper introduces CSC, a calibrated-simplicity framework for detecting social bots in the era of large language models. CSC combines a simplified prototype-guided graph expert, calibrated simplex-constrained fusion, and a lightweight inconsistency expert to address modality conflict between semantic and structural signals. Experiments on TwiBot-22, TwiBot-20, and MGStBot-large demonstrate that CSC improves calibrated decision quality while maintaining competitive performance across benchmarks.

By Yipeng Qian, Pengjie Zhao, Chaoxi Niu
arXiv Computation and Language
Sep 1

Detecting AI Impostors: How Do Middle Schoolers Identify LLM Agents in a Live Collaborative Setting?

arXiv:2608.30948v1 Announce Type: new Abstract: LLMs can imitate how people write, which raises concerns about impersonation, trust, and detection in social settings. These concerns are especially im...

By Dan Schumacher, Pragathi Durga Rajarajan, Haven Kotara, Roman Rendon, Kosi Atupulazi, Deepti Tagare, Ismaila Temitayo Sanusi, Fred G. Martin, Anthony Rios
arXiv Computation and Language
Sep 16

Towards Detecting AI-Assisted Responses in Online Surveys

The paper introduces ASURRE, a benchmark dataset for detecting AI‑assisted responses in online surveys. It evaluates how different LLM usage strategies—ranging from full generation to persona‑grounded agentic completion—affect the performance of existing machine‑generated text detectors. The study finds that while naive AI usage is easily detected, more sophisticated persona‑grounded agents approach chance performance, yet still leave identifiable behavioural traces that can be aggregated to improve detection.

By Qizhou Wang, Bogdan Mamaev, Christopher Leckie
arXiv AI
Sep 30

Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?

The paper investigates whether multimodal large language models (MLLMs) can generate and detect realistic multimodal fake news on social media. Using a multi‑agent framework—comprising a story agent, an image agent, and a critic agent—the authors produced over 9,000 paired multimodal news posts across science, health, and entertainment domains. They benchmarked 16 open‑ and closed‑source MLLMs for automated detection and found that most models fall far short of human accuracy, especially in identifying image authenticity, highlighting the need for stronger defenses against social media fake news.

By Jiyao Yang, Yang Liu, Zhenyue Qin, Qingyu Chen, Xiuzhen Zhang
arXiv AI
Sep 1

Free Speech and Artificial Intelligence

The paper examines how artificial intelligence impacts freedom of expression, focusing on two technologies: social media recommendation algorithms and conversational AI chatbots. It argues that recommendation algorithms shape speech visibility in the digital public sphere, making them relevant to free‑speech philosophy, while conversational AI raises questions about granting speech rights to agents and users’ right to information. The work also explores corporate speech rights for platforms and developers, aiming to highlight unresolved issues from AI’s rapid growth.

By Etienne Brown