arXiv AI
Jun 26
Human-AI Complementarity: A Goal for Amplified Oversight
arXiv:2510. 26518v2 Announce Type: replace Abstract: Human feedback is critical for aligning AI systems to human values.
Summarizing books with human feedback
Scaling human oversight of AI systems for tasks that are difficult to evaluate.
Related stories
arXiv AI
Jul 21
Nonuniformity Principle in Human-AI Coworking
arXiv:2607. 16530v1 Announce Type: new Abstract: As generative AI is increasingly applied to automate multi-step and high-stake workflows, human judgment and involvement remain essential for ensuring the quality of AI-generated outputs.
arXiv AI
2d ago
AI Evaluation Should Work With Humans
arXiv:2608. 13577v1 Announce Type: new Abstract: This position paper argues that the dominant paradigm of AI evaluation (which focuses on superhuman autonomous performance and so implicitly targets the goal of replacing humans) is guiding AI development in the wrong direction.
arXiv AI
6d ago
On Benchmarking Human-Like Intelligence in Machines
arXiv:2502. 20502v2 Announce Type: replace Abstract: Recent advances in Artificial Intelligence (AI) have yielded powerful computational models that, by learning from vast amounts of human-generated data, are increasingly posited as approximate models of human cognition.
OpenAI Blog
Jun 13, 2022
AI-written critiques help humans notice flaws
We trained “critique-writing” models to describe flaws in summaries. Human evaluators find flaws in summaries much more often when shown our model’s critiques.
arXiv AI
Jun 6
Human Oversight and Overload: Two Hidden and Costly Burdens of AI-Assisted Software Engineering
arXiv:2606. 05770v1 Announce Type: cross Abstract: AI is changing how software engineers work, but it often comes with hidden burdens and costs.
arXiv AI
Aug 7
Shaping Human-AI Interactions to Provide Improvement Pathways and Balance Competing Objectives
arXiv:2608. 05710v1 Announce Type: new Abstract: When an AI system is deployed, the individuals who use and or are evaluated by it form beliefs about how the system operates and use those beliefs to strategically present their preferences, behaviors, or attributes.
arXiv AI
Jun 12
(Human) Attention Is (Still) All You Need: Human oversight makes AI-assisted social science reliable
arXiv:2606. 12848v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for tasks once reserved for trained researchers, including hypothesis generation, specification choice, and drafting conclusions.
arXiv AI
5d ago
Humans are Missing from AI Coding Agent Research
arXiv:2608. 12355v1 Announce Type: cross Abstract: Recent progress in AI coding agent research has led to rapid improvements in agents' ability to autonomously perform complex software engineering tasks, from editing large codebases to executing long-horizon development workflows.
arXiv AI
Jul 24
pAI-Econ-claude: A Gated Human-in-the-Loop Multi-Agent Architecture for AI-Assisted Economic Theory Development
arXiv:2607. 21268v1 Announce Type: cross Abstract: In many social-science research tasks, such as economics, LLM-based agents must produce outputs for which no cheap, task-complete, machine-readable correctness signal exists.
arXiv AI
Jul 7
Human-Centric Reflective Architecture for Human-AI Collaborative Decision-Making
arXiv:2607. 03025v1 Announce Type: new Abstract: The use of Large Language Models (LLMs) across diverse areas of human activity-ranging from everyday tasks to safety-critical applications-aims to enhance decision-making effectiveness with minimal human feedback.
arXiv Machine Learning
Jun 18
The Road to Artificial SuperIntelligence: A Comprehensive Survey of Superalignment
arXiv:2412. 16468v4 Announce Type: replace Abstract: The emergence of large language models (LLMs) has sparked discussion on Artificial Superintelligence (ASI), a hypothetical AI system that surpasses human intelligence.