arXiv AI By Andrea Campagner, Federico Cabitza, Vincenzo Crupi

When Do Humans and Machines Truly Complement Each Other? Formal Conditions and Empirical Evidence for Human-AI Synergy

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Oct 28

Towards Human-AI Complementarity for AI Safety

The paper investigates human‑AI complementarity as a strategy for safer AI oversight, arguing that humans and models making different mistakes can combine judgments to produce stronger oversight signals. The authors present the largest known suite of safety‑relevant tasks (3,957 instances across 8 datasets and 6 domains) and a platform for measuring performance of humans, AI, and hybrid systems. Their study, based on 35,613 judgments from 416 raters, shows a notable complementarity effect but also finds that the tested assistance methods rarely improve over the best single source and that human raters corrected AI errors less often even as overall accuracy rose.

By Sander Lanbo Shi, Miranda Anna Christ, Eric Modesitt, Andrew Louis, Konrad Cheng, Brandon Thai Tran, Sewoong Lee, Ratnakar Pawar, Gaia Molinaro, Juliana Bain, Nandika Donthi, Maja Pavlovic, Annya Dahmani, Francesca Bianco, Abhishek Shah, Tyler Crosse, Arth Singh, Karissa Huang, Sukanya Krishna, Konstantinos Voudouris, David Demitri Africa, Joshua Jacob, Rishub Jain
arXiv AI
Sep 28

Bringing AI to Autonomous Systems -- From Cognition to Collective Intelligence

The article discusses autonomous systems as the pinnacle of AI development, emphasizing the need to blend connectionist and symbolic AI within systems engineering. It introduces a generic agent architecture that organizes behavior around long‑term memory and outlines challenges in linking sensory data to structured memory, goal‑oriented decision making, planning, and agent coordination for collective intelligence. The authors also explore agent trustworthiness, noting it extends beyond behavior to include cognitive validity, and propose methods for its evaluation while highlighting the gap between current capabilities and the envisioned autonomous multi‑agent systems.

By Joseph Sifakis