OpenAI Blog

Evolution through large models

arXiv Machine Learning
Sep 17

The evolution of sex for artificial intelligence: a population-genetic framework for multigenerational model populations

The paper draws a parallel between AI model development and population genetics, treating successive model generations as analogous to sexual and asexual reproduction. It demonstrates that training models on peers’ outputs reproduces classic genetic processes such as the Wright–Fisher model, while combining parents’ weights can either cancel or preserve inherited advantages depending on the method. Experiments across recurrent, feedforward, and language models confirm these analogies and reveal architecture‑specific biases, including the Fisher‑Muller effect and reproductive isolation when lineages learn conflicting conventions.

By Giorgio F. Gilestro
arXiv AI
Jun 10

Towards Diverse Scientific Hypothesis Search with Large Language Models

arXiv:2606. 10587v1 Announce Type: cross Abstract: Large language models (LLMs) are on the rise for accelerating scientific discovery, most recently in advanced tasks such as generating valid scientific hypotheses.

By Haorui Wang, Parshin Shojaee, Kazem Meidani, Kunyang Sun, Jos\'e Miguel Hern\'andez-Lobato, Teresa Head-Gordon, Jiajun He, Chandan K. Reddy, Chao Zhang, Yuanqi Du
arXiv AI
Sep 2

Flawed in Nature, Perfect through Evolution

arXiv:2609.00129v1 Announce Type: cross Abstract: The performance of artificial intelligence (AI) and machine learning (ML) models degrades when the problem they were trained on drifts. This is a nea...

By J. M. Diederik Kruijssen (Allora Foundation)
arXiv Machine Learning
Sep 11

The Oligarch Barely Steers Model Collapse in Multi-Model Ecosystems

The paper investigates whether an oligopolistic concentration of generative AI models accelerates or steers the phenomenon of model collapse when models are recursively trained on each other’s outputs. Using controlled ecosystems of 13 open‑source models and an injected probe that pushes one model’s market share to 90%, the authors find that varying market concentration has little effect on the speed or final state of collapse. Instead, the pace of collapse is largely determined by which models supply the training pool and how susceptible those models are to being carried along, with human‑written text in the pool roughly halving the drift.

By Yangze Liu, Zhongyi Han
arXiv Machine Learning
3d ago

Stable and Counterfactually Robust Physical World Models from Imposed Structure and Learned Physics

The paper introduces a world model that learns to predict the evolution of physical systems while respecting key physical principles. By hard‑coding a general structure—generating dynamics from the gradient of a learned energy via a fixed reversible operator and imposing constraints on energy, dissipation, and interventions—the model achieves second‑law compatible dissipation, accurate responses to parameter changes, long‑term stability, and robustness to disturbances. Experiments on an electromagnetic cavity, a particle‑in‑cell grid, and shallow‑water fluid demonstrate that the model can recover accurate constitutive functions, distinguish conserving from dissipating regimes, and transfer learned physics to unseen conditions, outperforming unconstrained models.

By Yufeng Wang, Parivesh Priye, Lu Wei, Haibin Ling