OpenAI Blog
May 22, 2023
Governance of superintelligence
Now is a good time to start thinking about the governance of superintelligence—future AI systems dramatically more capable than even AGI.
The Road to Artificial SuperIntelligence: A Comprehensive Survey of Superalignment
arXiv:2412. 16468v4 Announce Type: replace Abstract: The emergence of large language models (LLMs) has sparked discussion on Artificial Superintelligence (ASI), a hypothetical AI system that surpasses human intelligence.
Related stories
arXiv AI
Jun 3
Solipsistic Superintelligence is Unlikely to be Cooperative
arXiv:2606. 03237v1 Announce Type: new Abstract: AI's central challenge is shifting from capability to coexistence.
arXiv AI
Jun 12
From AGI to ASI
arXiv:2606. 12683v1 Announce Type: new Abstract: Over the last decade, building human-level artificial general intelligence has moved from far-fetched speculation to being a concrete next-decade target for many of the largest AI organisations.
arXiv AI
Jun 30
Situation Perception: A Necessary Primitive to Artificial Superintelligence
arXiv:2606. 30481v1 Announce Type: cross Abstract: Current large language models are extraordinary statistical engines.
arXiv AI
Jun 26
Human-AI Complementarity: A Goal for Amplified Oversight
arXiv:2510. 26518v2 Announce Type: replace Abstract: Human feedback is critical for aligning AI systems to human values.
arXiv AI
Jun 6
Human Oversight and Overload: Two Hidden and Costly Burdens of AI-Assisted Software Engineering
arXiv:2606. 05770v1 Announce Type: cross Abstract: AI is changing how software engineers work, but it often comes with hidden burdens and costs.
arXiv AI
5d ago
The AI Accountability Ecosystem in the Era of Language Models
arXiv:2608. 12320v1 Announce Type: cross Abstract: This article reviews and updates the framework for accountability in AI based on account- ability ecosystems.
Hugging Face Trending Papers
Jun 10
AI Researchers Must Help Lead Arms Control to Mitigate Military AI Risks
The advancement of AI capabilities compels researchers and the public to be more aware of its potential worldwide impact. A pressing near-term concern is the regulation of military AI applications.
arXiv AI
Jun 11
AI Researchers Must Help Lead Arms Control to Mitigate Military AI Risks
arXiv:2606. 11533v1 Announce Type: cross Abstract: The advancement of AI capabilities compels researchers and the public to be more aware of its potential worldwide impact.
arXiv AI
Jul 14
Comparing Socio-technical Design Principles with Guidelines for Human-centered AI
arXiv:2607. 10331v1 Announce Type: new Abstract: Human-centered AI (HCAI) refers to guidelines or principles that aim on ethi-cally oriented design of systems.
arXiv AI
Aug 7
The Closing Window: How Governments Could Lose Their Ability to Restrain Advanced AI
arXiv:2608. 05173v1 Announce Type: cross Abstract: As AI capabilities advance, AI systems will pose greater risks to national security and potentially humanity as a whole.
OpenAI Blog
Dec 14, 2023
Superalignment Fast Grants
We’re launching $10M in grants to support technical research towards the alignment and safety of superhuman AI systems, including weak-to-strong generalization, interpretability, scalable oversight, and more.