Disrupting malicious uses of AI by state-affiliated threat actors

Disrupting malicious uses of AI

Disrupting malicious uses of AI | February 2026

Our latest threat report examines how malicious actors combine AI models with websites and social platforms—and what it means for detection and defense.

Preparing for malicious uses of AI

We’ve co-authored a paper that forecasts how malicious actors could misuse AI technology, and potential ways we can prevent and mitigate these threats. This paper is the outcome of almost a year of sustained work with our colleagues at the Future of Humanity Institute, the Centre for the Study of Existential Risk, the Center for a New American Security, the Electronic Frontier Foundation, and others.

Disrupting malicious uses of AI: June 2025

Our latest report featuring case studies of how we’re detecting and preventing malicious uses of AI.

Cyber threat actors: AI-assisted intrusion research

OpenAI banned accounts potentially associated with publicly reported DPRK-affiliated threat actors using AI to research intrusion tooling, phishing, malware, and cryptocurrency targeting.

Disrupting deceptive uses of AI by covert influence operations

We’ve terminated accounts linked to covert influence operations; no significant audience increase due to our services.

Multi-Agent AI Control: Distributed Attacks Hamper Per-Instance Monitors

arXiv:2607. 07368v1 Announce Type: cross Abstract: AI control is a family of techniques to prevent an AI with malicious goals from subverting its operator's intent.

AI Agents Enable Adaptive Computer Worms

arXiv:2606. 03811v1 Announce Type: cross Abstract: A computer worm is malware that spreads on a network by replicating itself from one machine to another.

The Ethics of Autonomous AI Agents for Offensive Security

arXiv:2607. 20255v1 Announce Type: cross Abstract: LLM-driven autonomous agents are reshaping offensive security.

Malice in Agentland: Down the Rabbit Hole of Backdoors in the AI Supply Chain

arXiv:2510. 05159v5 Announce Type: replace-cross Abstract: While finetuning AI agents on interaction data -- such as web browsing or tool use -- improves their capabilities, it also introduces critical security vulnerabilities within the agentic AI supply chain.

AI Snitches Get Glitches: Towards Evading Agentic Surveillance

arXiv:2606. 25836v2 Announce Type: replace Abstract: To better assist users with completing challenging tasks, AI agents mediate communications, access data, and interact with different APIs.

AI Snitches Get Glitches: Towards Evading Agentic Surveillance

To better assist users with completing challenging tasks, AI agents mediate communications, access data, and interact with different APIs. Many employers (and even nation-states) already provide their users with this technology.