OpenAI Blog

Neural MMO: A massively multiagent game environment

We’re releasing a Neural MMO, a massively multiagent game environment for reinforcement learning agents. Our platform supports a large, variable number of agents within a persistent and open-ended task.

OpenAI Blog
Sep 17, 2019

Emergent tool use from multi-agent interaction

We’ve observed agents discovering progressively more complex tool use while playing a simple game of hide-and-seek. Through training in our new simulated hide-and-seek environment, agents build a series of six distinct strategies and counterstrategies, some of which we did not know our environment supported.

OpenAI Blog
Jun 8, 2017

Learning to cooperate, compete, and communicate

Multiagent environments where agents compete for resources are stepping stones on the path to AGI. Multiagent environments have two useful properties: first, there is a natural curriculum—the difficulty of the environment is determined by the skill of your competitors (and if you’re competing against clones of yourself, the environment exactly matches your skill level).

arXiv AI
Jul 14

Multi-Agent LLMs Fail to Explore Each Other

arXiv:2607. 11250v1 Announce Type: cross Abstract: Exploration is essential for reliable autonomy in multi-agent systems, yet it remains unclear whether large language model (LLM) agents can explore effectively when interacting with one another.

By Hyeong Kyu Choi, Jiatong Li, Wendi Li, Xin Eric Wang, Sharon Li
arXiv AI
3d ago

PhantomEnvironments: Training LLM Agents in Fictional Worlds

PhantomEnvironments is a framework that trains large language model agents in synthetic, rule‑generated fictional worlds. By creating multi‑turn reinforcement learning environments where agents search templated articles to answer multi‑hop questions, the approach eliminates the need for costly human data or hallucinated LLM‑generated settings. Agents trained in these zero‑cost, purely rule‑based worlds transfer effectively to real‑world multi‑hop search benchmarks, often surpassing models trained on real data, and demonstrate scalable search behavior that grows linearly with question difficulty.

By Anmol Kabra, Swathi Saravana Selvam, Albert Gong, Chao Wan, Christian Belardi, Dongyoung Go, Katie Z. Luo, Kilian Q. Weinberger
arXiv Computation and Language
Aug 27

SwarmWorld: Stigmergic technological evolution in societies of language-model agents

SwarmWorld demonstrates that homogeneous language‑model agents can self‑organize into evolving technological societies without assigned roles or direct communication. In a spatial environment, agents explore, process resources, construct artifacts, and write executable controllers that are later evaluated by a deterministic simulator. The resulting societies develop broader, more resilient technological portfolios than isolated search, with agents differentiating into exploration, construction, maintenance, and coordination roles as the world matures.

By Subhadeep Pal, Fiona Y. Wang, Markus J. Buehler
Hugging Face Trending Papers
Jun 3

AgentJet: A Flexible Swarm Training Framework for Agentic Reinforcement Learning

We present AgentJet, a distributed swarm training framework for large language model (LLM) agent reinforcement learning. Unlike centralized frameworks that tightly couple agent rollouts with model optimization, AgentJet adopts a decoupled multi-node architecture in which swarm server nodes host trainable models and run optimization on GPU clusters, whereas swarm client nodes execute arbitrary agents on arbitrary devices.