OpenAI Blog

GPT-5.5 Bio Bug Bounty

Explore the GPT-5. 5 Bio Bug Bounty: a red-teaming challenge to find universal jailbreaks for bio safety risks, with rewards up to $25,000.

arXiv Computation and Language
Oct 23

Beyond Attack Success Rate: Cost-Aware Metric for Evaluating Iterative LLM Jailbreaks

The paper introduces a new metric, ASR_STEP, that extends the traditional attack success rate (ASR) by penalizing repeated calls to a victim large language model during jailbreak attempts. Experiments on JailBreakBench show that GCG’s scores drop by 7.0–8.7 percentage points after discounting, while PAP’s scores remain unchanged, and PAIR’s discount ranges from 3.4–12 percentage points depending on the iterative strategy. The authors argue that reporting both ASR and ASR_STEP makes the cost of repeated victim-model interactions explicit.

By Rohan Menon, Chih-Hong Cheng
arXiv AI
Aug 5

AI Security Leaderboard: Methodology, Results and Minimal Standard

arXiv:2608. 03070v1 Announce Type: cross Abstract: Frontier AI model developers increasingly rely on layered safeguards to prevent catastrophic misuse, but little public evidence exists on how much protection these safeguards provide, or how consistently across developers.

By Jasper Timm, Lukas Struppek, Ziwei Xu, Grace Cheong, Oscar Mata, Dan Zhao, Mick Yang, Isadora De Andrade, Xiaojun Jia, Yiming Li, Samuel Bauer, Heather McIntyre, Adam Gleave, Edward Yee, Kellin Pelrine
OpenAI Blog
Oct 29, 2025

gpt-oss-safeguard technical report

gpt-oss-safeguard-120b and gpt-oss-safeguard-20b are two open-weight reasoning models post-trained from the gpt-oss models and trained to reason from a provided policy in order to label content under that policy. In this report, we describe gpt-oss-safeguard’s capabilities and provide our baseline safety evaluations on the gpt-oss-safeguard models, using the underlying gpt-oss models as a baseline.