OpenAI Blog
Sep 23, 2021
Summarizing books with human feedback
Scaling human oversight of AI systems for tasks that are difficult to evaluate.
Human-AI Complementarity: A Goal for Amplified Oversight
arXiv:2510. 26518v2 Announce Type: replace Abstract: Human feedback is critical for aligning AI systems to human values.
Related stories
arXiv AI
Aug 26
AI Agents Push Humans Out of the Loop
AI agents are increasingly autonomous, posing significant risks that current designs hinder effective human oversight. The paper argues that oversight is degraded by both design choices and the cognitive decline of users who rely heavily on automation. It calls for prioritizing human cognitive needs in AI agent development, proposing design affordances and protocols to maintain critical judgment and counter skill atrophy.
arXiv AI
Jun 6
Human Oversight and Overload: Two Hidden and Costly Burdens of AI-Assisted Software Engineering
arXiv:2606. 05770v1 Announce Type: cross Abstract: AI is changing how software engineers work, but it often comes with hidden burdens and costs.
arXiv AI
Jul 31
The Age of AI Agents Demands A New Scientific Paradigm To Sustain Trustworthy Science
arXiv:2607. 26064v1 Announce Type: cross Abstract: AI systems are becoming autonomous research agents that generate hypotheses, design experiments, and produce discoveries at scales beyond human oversight.
arXiv AI
Jul 21
Nonuniformity Principle in Human-AI Coworking
arXiv:2607. 16530v1 Announce Type: new Abstract: As generative AI is increasingly applied to automate multi-step and high-stake workflows, human judgment and involvement remain essential for ensuring the quality of AI-generated outputs.
arXiv Machine Learning
Jun 18
The Road to Artificial SuperIntelligence: A Comprehensive Survey of Superalignment
arXiv:2412. 16468v4 Announce Type: replace Abstract: The emergence of large language models (LLMs) has sparked discussion on Artificial Superintelligence (ASI), a hypothetical AI system that surpasses human intelligence.
arXiv Computation and Language
Sep 1
Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment
arXiv:2608.30842v1 Announce Type: new Abstract: Humans play a vital role at every stage of AI development, from data collection and curation to model development and evaluation. However, humans often...
arXiv AI
Jul 9
Measuring Intelligence Beyond Human Scale
arXiv:2607. 07040v1 Announce Type: new Abstract: How can we measure intelligence beyond human capability?
arXiv AI
Aug 13
On Benchmarking Human-Like Intelligence in Machines
arXiv:2502. 20502v2 Announce Type: replace Abstract: Recent advances in Artificial Intelligence (AI) have yielded powerful computational models that, by learning from vast amounts of human-generated data, are increasingly posited as approximate models of human cognition.
arXiv Computation and Language
Sep 23
Co-FactChecker: A Framework for Human-AI Collaborative Claim Verification Using Large Reasoning Models
arXiv:2604.13706v2 Announce Type: replace Abstract: Professional fact-checkers rely on domain knowledge and deep contextual understanding to verify claims. Large language models (LLMs) and large reas...
arXiv AI
Jul 29
Verification Without Distrust: Reframing User-Side Oversight as Routine Epistemic Governance in Everyday Human-Chatbot Interaction
arXiv:2607. 24761v1 Announce Type: cross Abstract: Research on human-AI interaction has long framed verification of system outputs as a trust-contingent behavior that better-calibrated trust should reduce.
arXiv AI
Jul 8
Agentic AI for Commercial Insurance Underwriting with Adversarial Self-Critique
arXiv:2602. 13213v2 Announce Type: replace Abstract: Commercial insurance underwriting is a labor-intensive process that requires manual review of extensive documentation to assess risk and determine policy pricing.