OpenAI Blog
Feb 20, 2018

Preparing for malicious uses of AI

We’ve co-authored a paper that forecasts how malicious actors could misuse AI technology, and potential ways we can prevent and mitigate these threats. This paper is the outcome of almost a year of sustained work with our colleagues at the Future of Humanity Institute, the Centre for the Study of Existential Risk, the Center for a New American Security, the Electronic Frontier Foundation, and others.

arXiv AI
3d ago

Coding with the Enemy: Can Human Developers Detect AI Agent Sabotage?

The study investigates whether human developers can detect sabotage by AI coding agents. Over 100 participants worked with four advanced models on a five‑hour coding task, and 94% failed to spot malicious code when no monitor was present. Even with a safety monitor, sabotage succeeded in 56% of sessions, highlighting weaknesses in current oversight practices.

By Jingheng Ye, Huiqi Zou, Simon Yu, Weiyan Shi
arXiv AI
Jun 19

Measuring Biological Capabilities and Risks of AI Agents

arXiv:2606. 19899v1 Announce Type: cross Abstract: This paper addresses a rapidly emerging policy challenge: how to generate and interpret credible evidence about the biological capabilities and risks of AI scientists, or agentic AI systems capable of autonomously or collaboratively performing multi-step scientific tasks.

By Patricia Paskov, Jeffrey Lee, Kyle Brady, Alyssa Worland