arXiv AI

Overview of Risk Assessment and Management for Intelligent Systems under the AI Act and Beyond

arXiv:2607. 02197v1 Announce Type: cross Abstract: The society and emerging risk-based regulatory frameworks for AI underscore the need for rigorous risk assessment to ensure safe and reliable AI systems.

arXiv AI
Jul 10

The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysis

arXiv:2408. 02379v2 Announce Type: replace-cross Abstract: Developing and certifying safe - or so-called trustworthy - AI has become an increasingly salient issue, especially in light of upcoming regulation such as the EU AI Act.

By Benjamin Fresz, Vincent Philipp G\"obels, Safa Omri, Danilo Brajovic, Andreas Aichele, Janika Kutz, Jens Neuh\"uttler, Marco F. Huber
arXiv AI
Jul 20

Harmonizing AI Safety Thresholds

arXiv:2607. 16112v1 Announce Type: new Abstract: Frontier AI companies have published capability thresholds that differ substantially, making it difficult for third parties to verify whether a threshold has been crossed or to compare requirements across companies.

By Wilber Sean Anterola, Matthew Ball, Luis F. Lafuerza, Markov Grey
arXiv AI
Jul 17

Unsafe at any AUC: Unlearned Lessons from Sociotechnical Disasters for Responsible AI

arXiv:2607. 14353v1 Announce Type: cross Abstract: As automated decision-making and data-driven technologies pervade society and are used to manage consequential outcomes, understanding the technology's capabilities, limitations, and attendant risks in context requires analysis of full sociotechnical systems.

By Joshua A. Kroll, Andrew Smart, R. Stuart Geiger, Abigail Z. Jacobs
arXiv AI
Jul 24

Regulating autonomous and agentic AI

arXiv:2607. 21345v1 Announce Type: new Abstract: Regulating activities where regulatees use autonomous and agentic AI is challenging.

By Chris Reed, Alex Austria, Anmol Bharuka, Pragnitha Mandava, Khushiya Mujawar, Luka Shakhkulashvili
OpenAI Blog
Feb 20, 2018

Preparing for malicious uses of AI

We’ve co-authored a paper that forecasts how malicious actors could misuse AI technology, and potential ways we can prevent and mitigate these threats. This paper is the outcome of almost a year of sustained work with our colleagues at the Future of Humanity Institute, the Centre for the Study of Existential Risk, the Center for a New American Security, the Electronic Frontier Foundation, and others.

OpenAI Blog
Jul 10, 2019

Why responsible AI development needs cooperation on safety

We’ve written a policy research paper identifying four strategies that can be used today to improve the likelihood of long-term industry cooperation on safety norms in AI: communicating risks and benefits, technical collaboration, increased transparency, and incentivizing standards. Our analysis shows that industry cooperation on safety will be instrumental in ensuring that AI systems are safe and beneficial, but competitive pressures could lead to a collective action problem, potentially causing AI companies to under-invest in safety.

OpenAI Blog
Apr 16, 2020

Improving verifiability in AI development

We’ve contributed to a multi-stakeholder report by 58 co-authors at 30 organizations, including the Centre for the Future of Intelligence, Mila, Schwartz Reisman Institute for Technology and Society, Center for Advanced Study in the Behavioral Sciences, and Center for Security and Emerging Technologies. This report describes 10 mechanisms to improve the verifiability of claims made about AI systems.