OpenAI Blog
Feb 13
Introducing Lockdown Mode and Elevated Risk labels in ChatGPT
Introducing Lockdown Mode and Elevated Risk labels in ChatGPT to help organizations defend against prompt injection and AI-driven data exfiltration.
Designing AI agents to resist prompt injection
How ChatGPT defends against prompt injection and social engineering by constraining risky actions and protecting sensitive data in agent workflows.
Related stories
OpenAI Blog
Apr 10
Responsible and safe use of AI
Learn how to use AI responsibly with best practices for safety, accuracy, and transparency when using tools like ChatGPT.
OpenAI Blog
Nov 7, 2025
Understanding prompt injections: a frontier security challenge
Prompt injections are a frontier security challenge for AI systems. Learn how these attacks work and how OpenAI is advancing research, training models, and building safeguards for users.
OpenAI Blog
Oct 15, 2024
Evaluating fairness in ChatGPT
We've analyzed how ChatGPT responds to users based on their name, using AI research assistants to protect privacy.
arXiv AI
Sep 16
Agentic Societies Need a Social Harness
arXiv:2609.17527v1 Announce Type: cross Abstract: An agentic society is a collection of AI agents that coordinate autonomously across trust boundaries, on behalf of different principals whose objecti...
OpenAI Blog
Dec 22, 2025
Continuously hardening ChatGPT Atlas against prompt injection
OpenAI is strengthening ChatGPT Atlas against prompt injection attacks using automated red teaming trained with reinforcement learning. This proactive discover-and-patch loop helps identify novel exploits early and harden the browser agent’s defenses as AI becomes more agentic.
OpenAI Blog
Feb 16, 2023
How should AI systems behave, and who should decide?
We’re clarifying how ChatGPT’s behavior is shaped and our plans for improving that behavior, allowing more user customization, and getting more public input into our decision-making in these areas.
OpenAI Blog
Jul 17, 2025
ChatGPT agent System Card
ChatGPT agent System Card: OpenAI’s agentic model unites research, browser automation, and code tools with safeguards under the Preparedness Framework.
arXiv Computation and Language
Sep 22
Beyond Single-Model Injection: A Threat Model and Defense Architecture for Prompt Injection in Multi-Agent Systems
arXiv:2609.22949v1 Announce Type: cross Abstract: Existing prompt injection research focuses on single-model chatbot scenarios, where an attacker manipulates one LLM through crafted input. Multi-agen...
arXiv AI
Aug 25
Concepts for Securing Agentic AI Coding and the Terok Environment
arXiv:2608.22930v1 Announce Type: new Abstract: Agentic AI is a fascinating new tool for software development. It is a huge step forward compared to "conventional" AI assisted coding, which in turn w...
arXiv AI
Jul 17
Bad Memory: Evaluating Prompt Injection Risks from Memory in Agentic Systems
arXiv:2607. 14611v1 Announce Type: cross Abstract: A growing class of agentic systems maintain persistent state across sessions through memory files, behavioral preferences, and knowledge bases.
arXiv AI
Aug 11
Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safety
arXiv:2608. 07902v1 Announce Type: cross Abstract: Youth increasingly turn to AI chatbots for social and emotional support, raising concerns about how these systems respond, especially in high-stakes situations.