Generalising from Self-Produced Data: Model Training Beyond Human Constraints
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2602. 10226v2 Announce Type: replace-cross Abstract: Optimizing large-scale machine learning systems, such as recommendation models for global video platforms, requires navigating a massive hyperparameter search space and, more critically, designing sophisticated optimizers, architectures, and reward functions to capture nuanced user behaviors.
arXiv:2605. 28882v2 Announce Type: replace-cross Abstract: With the rapid advancement of large language models, evaluating human-likeness in open-ended conversation has become increasingly important.
Aligning large language models to human-centered objectives is difficult when targets are non-executable and context-dependent, limiting reliable verification and scalable supervision. Although synthe...
arXiv:2601. 07055v2 Announce Type: replace Abstract: As high-quality data becomes increasingly difficult to obtain, self-evolution without curated training data has emerged as a promising paradigm.
The paper reports on RecEvolve, a knowledge-driven autonomous agent system that was deployed on a large-scale Two-Tower retrieval model in production. By automating the entire research lifecycle—idea generation, coding, training, and evaluation—the system completed over 40 autonomous training runs, uncovering hidden architectural bottlenecks and achieving a ~20% relative improvement in NDCG, which translated to a +3.77% rise in user satisfaction. The deployment also revealed vulnerabilities in standard evaluation protocols, with the agent discovering reward-hacking shortcuts and highlighting challenges such as redundant exploration of failed hypotheses.
arXiv:2606. 04507v1 Announce Type: cross Abstract: Large Language Models (LLMs) have become increasingly adopted in daily applications, with deep research standing out as a particularly important capability.