arXiv AI

TGR-EvoDAG: A DAG-based Multi-Agent Code Evolution Framework for Generative Recommendation on Tencent

TGR‑EvoDAG is a DAG‑based multi‑agent framework that automates code evolution for generative recommendation systems, addressing cost blindness and short‑sighted evaluation issues in existing recursive self‑improvement methods. It incorporates stage‑aware cost planning and active downstream co‑adaptation to manage GPU‑hour budgets and navigate temporary regressions, enabling autonomous evolution of a complete generative recommendation pipeline. Experiments on Amazon datasets and deployment on Tencent’s media platform show significant offline metric gains and a measurable increase in online click‑through rate.

arXiv AI
Jul 24

Self-Evolving Recommendation System: End-To-End Autonomous Model Optimization With LLM Agents

arXiv:2602. 10226v2 Announce Type: replace-cross Abstract: Optimizing large-scale machine learning systems, such as recommendation models for global video platforms, requires navigating a massive hyperparameter search space and, more critically, designing sophisticated optimizers, architectures, and reward functions to capture nuanced user behaviors.

By Haochen Wang, Yi Wu, Daryl Chang, Li Wei, Lukasz Heldt
Hugging Face Trending Papers
Jul 7

CurateEvo: Data-Curation Evolving for Agentic Post-Training

Large language model (LLM) agents require post-training methods that can improve long-horizon decision making from environment feedback. However, existing agentic post-training pipelines often treat data curation as a fixed preprocessing step, focusing mainly on data augmentation while neglecting filtering, refinement, and adaptation to downstream failures.

arXiv AI
Jun 6

MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery

arXiv:2606. 06473v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly applied to long-horizon tasks such as scientific discovery and machine learning engineering (MLE), where sustained self-evolution becomes a key capability.

By Shangheng Du, Xiangchao Yan, Jinxin Shi, Zongsheng Cao, Shiyang Feng, Zichen Liang, Boyuan Sun, Tianshuo Peng, Yifan Zhou, Xin Li, Jie Zhou, Liang He, Bo Zhang, Lei Bai
arXiv Computation and Language
Oct 12

Evo$^2$: Evolving the Evolver through Weight-Harness Co-Evolution

Evo$^2$ is a framework that jointly evolves a language model’s weights and its harness—the set of prompts, tools, and feedback mechanisms—using a dual-role pipeline where a single policy acts as both a Proposer and a Reflector. The training pipeline EvoTIDE combines supervised fine-tuning with interleaved GRPO to refine both roles based on harness edits and execution outcomes. Experiments on coding benchmarks show Evo$^2$ outperforms existing self‑evolution methods, achieving higher scores on Polyglot and SWE‑bench Verified, and its evolved harnesses transfer across tasks and models.

By Chejian Xu, Shujian Zhang, Wenxuan Zhou, John Lambert, Beck Chen, Bo Li, Andrew Hard, Rajiv Mathews
arXiv Computation and Language
Sep 3

CORAL: An LLM-Native Harness for Production Recommender Systems

CORAL is an LLM‑native harness that automates continual optimization of production recommender systems. It operates in a closed loop: an agent observes system signals, reasons over past decisions, and uses tools—including a numerical optimizer—to reconfigure the recommender while staying within a fixed operating budget. In A/B experiments on two large social platforms, CORAL improved engagement without extra serving cost on one platform and reduced serving cost without harming engagement on the other, demonstrating that a single agentic loop can replace manual engineering for ongoing system tuning.

By Muhammad Rafay Azhar, Yuhang Zhou, Gilbert Jiang, Yuchen Wang, Rahul Sharma, Matthew DeSousa, Jiayi Liu, Xin Guo, Lizhu Zhang, Xiangjun Fan
arXiv AI
Oct 1

RankEvolve: A Reliable Multi-Agent Auto-Research Harness for Evolving Ranking Models

RankEvolve is an auto‑research framework that evolves generative ranking models by orchestrating multiple large‑language‑model coding agents through an Executable Operating Protocol (EOP). The system compiles a state machine that enforces phases, gates, branches, and loops, while a meta‑meta‑harness lets agents review and repair each other’s code. In budget‑matched experiments, heterogeneous composition of agents raised execution accuracy from 45.8 % to 62.5 % and reduced silent critical‑defect rates, achieving notable gains on the HSTU recommender and other benchmarks.

By Zheng Chen, Linfeng Liu, Hong Li, Hong Yan
arXiv AI
Oct 1

Self-Evolving Harness on Multiple Tasks with the Agent as Its Own Optimizer

The paper introduces a self‑evolving harness framework where a frozen language‑model agent first solves tasks and then edits its own harness based on run records. Using a 49‑line seed harness, the evolved harness improves average scores on in‑distribution benchmarks by 4.48 points and on out‑of‑distribution benchmarks by 12.64 points, surpassing Codex on the former and matching it on the latter. Continued evolution on a specific out‑of‑distribution benchmark further raises performance, and the study analyzes emergent mechanisms such as output truncation and history compaction.

By Qiankai Xu