arXiv Machine Learning By Yikai Wang, Chuansai Zhou, Yuhang Zhou, Weiqiang Wu, Cong Wu, Yue Deng, Ben Feng, Mingming Zhu, Beirong Zhou, Zhibin Wang, Sheng Zhong, Chen Tian, Wangze Zhang

MoE Proxy Models for Low-Cost Failure Reproduction and Diagnosis in LLM RL Post-Training

Read the original on arXiv Machine Learning →

arXiv:2608. 10823v1 Announce Type: new Abstract: Reinforcement learning (RL) post-training of large language models (LLMs) is computationally intensive and involves complex system pipelines with substantial debugging overhead.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 12

Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agents

Ecdysis is a framework for training runtime harnesses for large language model agents that reduces training time and improves performance. It distinguishes between model‑specific issues and systematic harness deficiencies by aggregating failures across multiple task instances and uses Failure‑Driven Collaborative Refinement to diagnose and correct harness problems. Experiments show up to a 1.84× speedup in harness training and an 18.56% increase in reasoning accuracy.

By Ruiqing Yue, Yu Cui, Zhuoyu Sun, Sicheng Pan, Xianhong Xue, Tingyu Li, Ting Li, Wenzhuo Zhu, Yi Chen, Yifei Liu, Baohan Huang, Zhe Cui, Haibin Zhang, Cong Zuo
Hugging Face Trending Papers
Sep 10

Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agents

Ecdysis is a framework for training runtime harnesses for large language model agents more efficiently. It distinguishes between model‑specific issues and systematic harness deficiencies by aggregating failures across multiple task instances and uses Failure‑Driven Collaborative Refinement to diagnose and fix harness problems. The approach reduces training time by up to 1.84× and improves harness reasoning accuracy by 18.56%.

arXiv Machine Learning
Jul 2

Is One Layer Enough? Training A Single Transformer Layer Can Match Full-Parameter RL Training

arXiv:2607. 01232v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a central component of post-training large language models (LLMs), yet little is understood about how RL adaptation is distributed across transformer layers.

By Zijian Zhang, Rizhen Hu, Athanasios Glentis, Dawei Li, Chung-Yiu Yau, Hongzhou Lin, Mingyi Hong