OpenAI Blog

Learning to cooperate, compete, and communicate

Multiagent environments where agents compete for resources are stepping stones on the path to AGI. Multiagent environments have two useful properties: first, there is a natural curriculum—the difficulty of the environment is determined by the skill of your competitors (and if you’re competing against clones of yourself, the environment exactly matches your skill level).

OpenAI Blog
Dec 11, 2025

Ten years

OpenAI reflects on ten years of progress, from early research breakthroughs to widely used AI systems that reshaped what’s possible. We share lessons from the past decade and why we remain optimistic about building AGI that benefits all of humanity.

arXiv AI
Sep 12

Defining AI Agents: A Compendium of Criteria, Metrics, and Benchmarks

The article "Defining AI Agents: A Compendium of Criteria, Metrics, and Benchmarks" surveys the lack of a standard definition for AI agents and organizes this ambiguity into five dimensions: environmental interaction, learning and adaptation, autonomy, goal‑directed behavior, and temporal coherence. It reviews how each dimension has been conceptualized in prior work and compiles the metrics, benchmarks, and evaluation frameworks used to assess them. The authors also introduce the Agent Compendium, a public digital resource that extends these evaluation methods, aiming to provide a common structure for evaluating and comparing agent capabilities across AI systems.

By Mia Lassiter, Brinnae Bent
arXiv AI
Jun 2

Agyn: An Open-Source Platform for AI Agents with Scalable On-Demand Execution, Agent Definition as a Code, and Zero-Trust Access

arXiv:2605. 27575v2 Announce Type: replace Abstract: As organizations move toward production deployments of AI agents, which execute non-deterministic workflows, maintain stateful sessions, and often operate with privileged access to internal services, the engineering challenge shifts from building individual agents to operating them at scale with proper isolation, governance, and security.

By Nikita Benkovich, Vitalii Valkov
arXiv AI
Jun 8

Measuring Agents in Production

arXiv:2512. 04123v4 Announce Type: replace-cross Abstract: LLM-based agents already operate in production across many industries, yet we lack an understanding of what technical methods make deployments successful.

By Melissa Z. Pan, Negar Arabzadeh, Riccardo Cogo, Yuxuan Zhu, Alexander Xiong, Lakshya A Agrawal, Huanzhi Mao, Emma Shen, Sid Pallerla, Liana Patel, Shu Liu, Tianneng Shi, Xiaoyuan Liu, Jared Quincy Davis, Emmanuele Lacavalla, Alessandro Basile, Shuyi Yang, Paul Castro, Daniel Kang, Koushik Sen, Dawn Song, Joseph E. Gonzalez, Ion Stoica, Matei Zaharia, Marquita Ellis
Towards Data Science
Jul 10

The Big Con of Agentic AI

What our over-dependence on external consulting teaches us about delegating our minds to machines The post The Big Con of Agentic AI appeared first on Towards Data Science .

By Chinmay Kakatkar
arXiv Computation and Language
Aug 27

SwarmWorld: Stigmergic technological evolution in societies of language-model agents

SwarmWorld demonstrates that homogeneous language‑model agents can self‑organize into evolving technological societies without assigned roles or direct communication. In a spatial environment, agents explore, process resources, construct artifacts, and write executable controllers that are later evaluated by a deterministic simulator. The resulting societies develop broader, more resilient technological portfolios than isolated search, with agents differentiating into exploration, construction, maintenance, and coordination roles as the world matures.

By Subhadeep Pal, Fiona Y. Wang, Markus J. Buehler