arXiv Machine Learning By Xiukun Wei, Yang Zhang, Xueru Zhang

Stability and Diversity of Networked Self-Consuming Generative Ecosystems

Read the original on arXiv Machine Learning →

The paper examines how multiple generative models can form a networked self‑consuming loop, where each model consumes synthetic data produced by others. It introduces a graph‑based theoretical framework that models these interactions as directed, weighted edges and uses it to analyze long‑term retraining dynamics, identifying conditions for convergence and the nature of fixed points. The study also explores how real‑data access, cross‑model consumption, and graph structure influence the system’s stability and diversity.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 8

Self-Consuming Generative Models with Co-Evolving Human Preferences

The paper examines generative models that are trained through self‑consuming loops where users curate preferred samples. It shows that when training relies solely on user‑curated synthetic data, initial biases are amplified, leading the system to converge to a single dominant outcome. Introducing reference data at a sufficient rate changes the dynamics, producing a unique globally attracting equilibrium, and the authors propose an algorithm to select reference distributions and mixing weights to steer the system toward desirable equilibria while reducing data collection costs.

By Xiukun Wei, Tian Xie, Ding Zhu, Xueru Zhang