arXiv AI

Responsible GenAI Use During Active Armed Conflict: Evidence from Sudan's Emergency Response Rooms

The study investigates how community‑led humanitarian responders in Sudan’s Emergency Response Rooms use Generative AI during armed conflict. Through surveys and interviews, it finds that responders rely on GenAI when human expertise is hard to reach, yet they warn that the technology cannot independently capture rapidly changing local conditions and may lead to harmful decisions if not verified. Risks also arise before use, such as exposure to danger from carrying devices or sharing sensitive information, and concerns that AI‑assisted reports could damage credibility with donors.

arXiv Machine Learning
Jun 26

Can Large Language Models Reliably Code Qualitative Humanitarian Data? A Benchmark Study Against Human Expert Adjudication

arXiv:2606. 26541v1 Announce Type: new Abstract: Data from affected populations are crucial for informing humanitarian response, but their value depends on timely and consistent interpretation of nuanced accounts of need.

By Jerome Marston, Tino Kreutzer, Salom\'e Garnier, Ella Boone, Phuong N Pham, Patrick Vinck
arXiv AI
5d ago

Who Can Evaluate AI Independently? A Framework for Analysing Evaluation Infrastructure

The paper "Who Can Evaluate AI Independently? A Framework for Analysing Evaluation Infrastructure" introduces the PAAI framework—Power, Access, Adequacy, Independence—to assess who controls AI evaluation infrastructure and how that shapes independent evaluation. Applying PAAI to twelve African AI evaluation projects and three joint testing exercises of the AI Safety Institutes, the authors identify three recurring configurations: extractive collaboration, dependent innovation, and constrained independence. The study finds that African actors often provide data and expertise while external institutions retain control over infrastructure and evaluation frameworks, and that participation alone does not confer evaluative authority.

By Sumaya Nur Adan, Joanna Wiaterek, Nourhan Abdelrhim, Sydney Reis, Robert F. Trager, Benjamin Rosman, Marina Jirotka
arXiv AI
Jul 1

RCTs for Frontier AI Governance: Methodological Challenges and Solutions for Human Uplift Studies

arXiv:2603. 11001v3 Announce Type: replace-cross Abstract: Human uplift studies, or studies that measure the effects of AI access on human performance via randomized controlled trials (RCT) or similar methodologies, increasingly inform frontier AI governance and deployment decisions.

By Patricia Paskov, Kevin Wei, Shen Zhou Hong, Dan Bateyko, Xavier Roberts-Gaal, Carson Ezell, Gailius Praninskas, Valerie Chen, Umang Bhatt, Ella Guest
Hugging Face Trending Papers
Aug 11

Conversational versus Dashboard Explainable AI for UAV Intrusion Detection: An Empirical Study of Operator Trust and Reliance

Machine learning-based Intrusion Detection Systems (IDS) have demonstrated superior performance in securing Unmanned Aerial Vehicle (UAV) networks. However, the 'black-box' nature of these models, combined with the high dimensionality of multimodal cyber-physical data, poses significant interpretability challenges.

arXiv AI
Oct 27

The As-If Machine: Personalized counterfactuals make distant policy risks feel close

The As-If Machine (AIM) is a multi‑agent AI system that lets participants co‑write personalized counterfactual narratives about their own lives under different policy futures. In two large experiments—one on science funding and one on satellite cybersecurity—AIM significantly increased participants’ psychological closeness to the risks compared with expert vignettes and unrelated writing, with effects ranging from 0.36 to 0.90 standard deviations. Across 23,496 human‑AI interactions, AIM provided concrete detail while participants supplied first‑person perspective and emotion, demonstrating that co‑writing with AI can make distant policy risks feel immediate and personal.

By Joshua Ashkinaze, Yubo Zhou, Pengyu Chen, Avi Bhattacharya, Hyebin Park, Yanman Zhang, Stephanie Preston, Eric Gilbert, Ceren Budak