arXiv AI June 18, 2026 By Haoyang Fang, Wei Zhu, Boran Han, Alex Zhang, Zhenyu Pan, Shuo Yang, Shuai Zhang, Jiading Gai, Peng Tang, Cuixiong Hu, Xuan Zhu, Huzefa Rangwala, George Karypis, Bernie Wang

LLMZero: Discovering Adaptive Training Strategies for RL Post-Training via LLM Agents

Read the original on arXiv AI →

arXiv:2606. 18388v1 Announce Type: cross Abstract: RL post-training strategies are dataset-dependent and reveal a recurring empirical pattern: capacity parameters accumulate monotonically across stages, while regularization parameters predominantly oscillate in response to shifting training dynamics.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning

Aug 11

Matching Accuracy, Different Geometry: Evolution Strategies vs GRPO in LLM Post-Training

arXiv:2604. 01499v2 Announce Type: replace Abstract: Evolution Strategies (ES) have emerged as a scalable gradient-free alternative to reinforcement learning based LLM fine-tuning, but it remains unclear whether comparable task performance implies comparable solutions in parameter space.

By William Hoy, Binxu Wang, Xu Pan

llms reinforcement-learning fine-tuning

arXiv Machine Learning

Aug 4

Cooperative Coevolution for Resource-Constrained Agentic LLM Post-Training

arXiv:2608. 02391v1 Announce Type: cross Abstract: Tool-using large language model (LLM) agents produce long, multi-turn trajectories, making gradient-based post-training memory-intensive.

By Zhiyuan Wang, Shengcai Liu, Jiahao Wu, Ning Lu, Hui Ouyang, Shaofeng Zhang, Haoze Lv, Ke Tang

llms agents reinforcement-learning fine-tuning benchmarks

arXiv AI

Jul 15

Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning

arXiv:2509. 24372v3 Announce Type: replace-cross Abstract: Fine-tuning large language models (LLMs) for downstream tasks is an essential stage of modern AI deployment.

By Xin Qiu, Yulu Gan, Conor F. Hayes, Qiyao Liang, Yinggan Xu, Roberto Dailey, Elliot Meyerson, Babak Hodjat, Risto Miikkulainen

llms reinforcement-learning fine-tuning benchmarks

arXiv Machine Learning

Aug 19

Agentic ESOpt: Fine-Tuning Long-Horizon LLM Agents with Minimal GPU Requirements

Agentic ESOpt proposes using evolution strategies (ES) instead of reinforcement learning to fine‑tune large language‑model agents for long‑horizon tasks. ES offers model scalability, flexibility, and better long‑horizon credit assignment, enabling full‑parameter optimization with minimal GPU memory. The framework samples parameter perturbations, evaluates agents with rewards, and updates online, achieving notable performance gains on WebArena‑Lite and in test‑time prompt‑parameter co‑evolution.

By Zhi Zheng, Rongsheng Chen, Yunpeng Ba, Zhenkun Wang, Yee Whye Teh, Wee Sun Lee

llms agents reinforcement-learning fine-tuning

arXiv Machine Learning

Jun 30

Evolution Fine-Tuning: Learning to Discover Across 371 Optimization Tasks

arXiv:2606. 29082v1 Announce Type: cross Abstract: Would experience designing faster GPU kernels also help close in on a long-standing open mathematical conjecture?

By Young-Jun Lee, Seungone Kim, Minki Kang, Alistair Cheong Liang Chuen, Zerui Chen, Seungho Han, Taehee Jung, Dongyeop Kang

llms agents reinforcement-learning fine-tuning benchmarks

arXiv AI

Jul 7

No Time Like the Present: Agentic Test-Time Training for LLM Agents

arXiv:2607. 03441v1 Announce Type: cross Abstract: LLM agents often degrade over long episodes: as trajectories grow, they revisit explored states, repeat failed actions, and lose strategies that previously worked.

By Yanbo Wang, Jinhua Hao, Yuze Shi, Kun Yuan, Ming Sun

llms agents fine-tuning

One email a morning, machine-written

Related stories

Matching Accuracy, Different Geometry: Evolution Strategies vs GRPO in LLM Post-Training

Cooperative Coevolution for Resource-Constrained Agentic LLM Post-Training

Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning

Agentic ESOpt: Fine-Tuning Long-Horizon LLM Agents with Minimal GPU Requirements

Evolution Fine-Tuning: Learning to Discover Across 371 Optimization Tasks

No Time Like the Present: Agentic Test-Time Training for LLM Agents