arXiv AI

When Do Humans and Machines Truly Complement Each Other? Formal Conditions and Empirical Evidence for Human-AI Synergy

arXiv AI
Oct 28

Towards Human-AI Complementarity for AI Safety

The paper investigates human‑AI complementarity as a strategy for safer AI oversight, arguing that humans and models making different mistakes can combine judgments to produce stronger oversight signals. The authors present the largest known suite of safety‑relevant tasks (3,957 instances across 8 datasets and 6 domains) and a platform for measuring performance of humans, AI, and hybrid systems. Their study, based on 35,613 judgments from 416 raters, shows a notable complementarity effect but also finds that the tested assistance methods rarely improve over the best single source and that human raters corrected AI errors less often even as overall accuracy rose.

By Sander Lanbo Shi, Miranda Anna Christ, Eric Modesitt, Andrew Louis, Konrad Cheng, Brandon Thai Tran, Sewoong Lee, Ratnakar Pawar, Gaia Molinaro, Juliana Bain, Nandika Donthi, Maja Pavlovic, Annya Dahmani, Francesca Bianco, Abhishek Shah, Tyler Crosse, Arth Singh, Karissa Huang, Sukanya Krishna, Konstantinos Voudouris, David Demitri Africa, Joshua Jacob, Rishub Jain
arXiv AI
Sep 28

Bringing AI to Autonomous Systems -- From Cognition to Collective Intelligence

The article discusses autonomous systems as the pinnacle of AI development, emphasizing the need to blend connectionist and symbolic AI within systems engineering. It introduces a generic agent architecture that organizes behavior around long‑term memory and outlines challenges in linking sensory data to structured memory, goal‑oriented decision making, planning, and agent coordination for collective intelligence. The authors also explore agent trustworthiness, noting it extends beyond behavior to include cognitive validity, and propose methods for its evaluation while highlighting the gap between current capabilities and the envisioned autonomous multi‑agent systems.

By Joseph Sifakis
arXiv AI
Aug 19

Supporting Calibrated Reliance in Human-AI Collaboration: Different Strategies for Different Tasks

The study investigates how different AI support formats influence human decision-making across two tasks: abstract visual reasoning with RAVEN matrices and deductive logical reasoning with LSAT problems. Findings reveal that in visual reasoning, predictions alone and predicted probabilities best support accuracy and error recovery, while in logical reasoning, LLM explanations outperform other supports. The results suggest that effective human–AI collaboration requires task‑specific support strategies rather than a one‑size‑fits‑all approach.

By Ruth Cohen, Lu Feng, Ayala Bloch, Sarit Kraus
arXiv AI
Jul 17

Align AI to Dynamic Human-AI Workflows

arXiv:2607. 14240v1 Announce Type: new Abstract: Current alignment approaches typically focus on emulating human behavior using static representations of human preferences, failing to capture the dynamic, context-dependent nature of real-world human-AI interactions.

By Valerie Chen, Cleotilde Gonzalez, Anita Williams Woolley, Michael Lee, Tongshuang Wu, Vincent Conitzer, Aarti Singh
arXiv AI
Sep 11

Cognitive Amplification vs Cognitive Delegation in Human-AI Systems: A Metric Framework

The paper proposes a metric framework to differentiate cognitive amplification—where AI enhances human performance without eroding human capability—from cognitive delegation, which relies heavily on AI reasoning. It introduces four metrics (CAI*, D, HRI, HCDR) and tests them in NetLogo simulations across various reliance and dependency scenarios. The results show that positive collaborative gain is only achievable when an explicit interaction term is added, indicating that mere prevention of capability erosion is insufficient for genuine amplification.

By Eduardo Di Santi, Carla Florida