arXiv AI July 1, 2026 By Daniele Gambetta, Gizem Gezici, Fosca Giannotti, Dino Pedreschi, Alistair Knott, Luca Pappalardo

Learning by Surprise: Adaptive Mitigation of Model Collapse in Large Language Models

Read the original on arXiv AI →

arXiv:2410. 12341v4 Announce Type: replace-cross Abstract: As AI-generated content increasingly populates the web, generative AI models are at growing risk of being trained on their own outputs, a process known as AI autophagy.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning

Jul 31

Epistemic diversity across language models mitigates knowledge collapse

arXiv:2512. 15011v3 Announce Type: replace Abstract: Artificial intelligence (AI) increasingly generates the very content used to train future AI systems.

By Damian Hodel, Jevin D. West

llms

arXiv AI

Jul 17

Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity

arXiv:2510. 01171v4 Announce Type: replace-cross Abstract: Post-training alignment often reduces LLM diversity, leading to a phenomenon known as mode collapse.

By Jiayi Zhang, Simon Yu, Derek Chong, Anthony Sicilia, Michael R. Tomz, Christopher D. Manning, Weiyan Shi

llms safety

arXiv AI

Jun 26

Limited Reference, Reliable Generation: A Two-Component Framework for Tabular Data Generation in Low-Data Regimes

arXiv:2509. 09960v2 Announce Type: replace-cross Abstract: Synthetic tabular data generation is increasingly essential in machine learning, supporting downstream applications when real-world, high-quality tabular data is insufficient.

By Mingxuan Jiang, Keyang Chen, Yongxin Wang, Yongsheng Zhao, Ziyue Dai, Yicun Liu, Zeping Li, Qiuyang Zhang, Hongyi Nie, Hongbin Zhu, Sen Liu, Guangnan Ye, Hongfeng Chai

llms diffusion fine-tuning benchmarks safety

arXiv AI

Aug 25

Reviewing Model Collapse and Countermeasures

arXiv:2608.21366v1 Announce Type: new Abstract: Driven by massive amounts of web-scale data, generative AI (GenAI) has achieved remarkable progress, enabling various applications in diverse sectors....

By Xihao Xie, Beichen Hu

arXiv AI

Jul 21

Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoning

arXiv:2505. 20161v2 Announce Type: replace-cross Abstract: Effective generalization in language models depends critically on the diversity of their training data.

By Jaehun Jung, Seungju Han, Ximing Lu, Skyler Hallinan, David Acuna, Shrimai Prabhumoye, Mostafa Patwary, Mohammad Shoeybi, Bryan Catanzaro, Yejin Choi

llms benchmarks

arXiv AI

Jul 22

Large Language Models Explore by Latent Distilling

arXiv:2604. 24927v2 Announce Type: replace-cross Abstract: Generating diverse responses is crucial for test-time scaling of large language models (LLMs), yet standard stochastic sampling mostly yields surface-level lexical variation, limiting semantic exploration.

By Yuanhao Zeng, Ao Lu, Lufei Li, Zheng Zhang, Yexin Li, Kan Ren

llms benchmarks

One email a morning, machine-written

Related stories

Epistemic diversity across language models mitigates knowledge collapse

Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity

Limited Reference, Reliable Generation: A Two-Component Framework for Tabular Data Generation in Low-Data Regimes

Reviewing Model Collapse and Countermeasures

Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoning

Large Language Models Explore by Latent Distilling