arXiv Machine Learning By Yingbo Hao, Song Liu, Guanghua Yu, Zhaojing Zhou, Jianchen Zhu, Yi Zou

InterQ-RL: Interaction-Aware Correction of Execution Mismatch in Quantized Agentic RL

Read the original on arXiv Machine Learning →

InterQ‑RL is a new method for multi‑turn agent reinforcement learning that addresses execution mismatch caused by low‑precision quantized rollouts. It corrects the mismatch by applying bounded execution‑prefix adjustments over the policy history, allocating correction strength across action segments within a fixed displacement budget, and does so without extra model forward passes. Experiments on ALFWorld, WebShop, and ScienceWorld with 4B‑30B backbones show that InterQ‑RL achieves the best quantized performance, matching BF16 within 0.7 points and surpassing it in two settings while maintaining or improving learning speed.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 7

TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models

arXiv:2610.07767v1 Announce Type: new Abstract: Reinforcement learning (RL) for post-training large language models (LLMs) incurs substantial computation and memory overhead during rollout generation...

By Xin Wang, Hao Yu, Zhengyang Zhuge, Bochao Mao, Zheng Li, Junda Feng, Yuyan Luo, Yi Zhang, Yizhong Cao, Mi Zhang, Dayiheng Liu, Jianwei Zhang
arXiv Machine Learning
Jul 20

QUADS: Stabilizing NVFP4 Reinforcement Learning for MoE via QUantization-error Alignment across Dual Sides

arXiv:2607. 15810v1 Announce Type: new Abstract: Rollout generation is a major bottleneck in Reinforcement Learning (RL) for Mixture-of-Experts (MoE) Large Language Models, motivating low-precision rollout acceleration such as FP8.

By Zhengyang Zhuge, Hao Yu, Xin Wang, Zheng Li, Yizhong Cao, Dayiheng Liu, Jianwei Zhang