The paper examines generative models that are trained through self‑consuming loops where users curate preferred samples. It shows that when training relies solely on user‑curated synthetic data, initial biases are amplified, leading the system to converge to a single dominant outcome. Introducing reference data at a sufficient rate changes the dynamics, producing a unique globally attracting equilibrium, and the authors propose an algorithm to select reference distributions and mixing weights to steer the system toward desirable equilibria while reducing data collection costs.
By Xiukun Wei, Tian Xie, Ding Zhu, Xueru Zhang
arXiv:2510. 16657v3 Announce Type: replace-cross Abstract: Synthetic data has been increasingly used to train frontier generative models.
By Bingji Yi, Qiyuan Liu, Yuwei Cheng, Haifeng Xu
arXiv:2512. 15011v3 Announce Type: replace Abstract: Artificial intelligence (AI) increasingly generates the very content used to train future AI systems.
By Damian Hodel, Jevin D. West
arXiv:2602. 16065v2 Announce Type: replace-cross Abstract: As artificial intelligence (AI)-generated content proliferates, models are increasingly trained on their own outputs, risking progressive degradation or collapse.
By Kevin Wang, Hongqian Niu, Didong Li
arXiv:2608.21366v1 Announce Type: new
Abstract: Driven by massive amounts of web-scale data, generative AI (GenAI) has achieved remarkable progress, enabling various applications in diverse sectors....
By Xihao Xie, Beichen Hu
arXiv:2502. 18049v5 Announce Type: replace-cross Abstract: Recent studies identified an intriguing phenomenon in recursive generative model training known as model collapse, where models trained on data generated by previous models exhibit severe performance degradation.
By Hengzhi He, Shirong Xu, Guang Cheng