arXiv AI June 2, 2026 By Weichen Yu, Xiaomin Li, Yizhou Zhao, Xiaoze Liu, Ruowang Zhang, Haixin Wang, Yinyi Luo, Chen Henry Wu, Gaurav Mittal, Matt Fredrikson, Yu Hu

Multi-Rollout On-Policy Distillation via Peer Successes and Failures

Read the original on arXiv AI →

arXiv:2605. 12652v2 Announce Type: replace-cross Abstract: Large language models are often post-trained with sparse verifier rewards, which indicate whether a sampled trajectory succeeds but provide limited guidance about where reasoning succeeds or fails.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Aug 26

Skill-Conditioned Gated Self-Distillation for LLM Reasoning

arXiv:2605.28791v2 Announce Type: replace-cross Abstract: On-policy self-distillation (SD) improves LLM reasoning by using teacher-side privileged information (PI) to turn sparse verifier outcomes in...

By Jiazhen Huang, Xiao Chen, Xiao Luo, Yong Dai, Senkang Hu, Yuzhi Zhao

llms efficiency benchmarks

arXiv AI

Jun 9

Trajectory-Refined Distillation

arXiv:2606. 08432v1 Announce Type: new Abstract: On-policy distillation (OPD) has become a central post-training tool for large language models (LLMs), providing dense per-token teacher supervision along the student's own rollouts.

By Li Jiang, Haoran Xu, Yichuan Ding, Amy Zhang

llms efficiency benchmarks

arXiv AI

Jun 2

OGLS-SD: On-Policy Self-Distillation with Outcome-Guided Logit Steering for LLM Reasoning

arXiv:2605. 12400v2 Announce Type: replace-cross Abstract: We study on-policy self-distillation (OPSD), where a language model improves its reasoning ability by distilling privileged teacher distributions along its own on-policy trajectories.

By Yuxiao Yang, Xiaoyun Wang, Weitong Zhang

llms efficiency benchmarks

Hugging Face Trending Papers

Jun 14

Localizing Credit at the Divergence: Path-Conditioned Self-Distillation for LLM Reasoning

Reinforcement learning from verifiable rewards assigns a single scalar to each rollout, leaving token-level credit assignment underspecified in long reasoning traces. On-policy self-distillation addresses this by letting the same model act as a teacher conditioned on privileged information, producing a dense per-token signal.

llms reinforcement-learning efficiency benchmarks

arXiv AI

Aug 21

Beyond Imitation: Filtering On-Policy Distillation by Reasoning Progress

arXiv:2608. 19408v1 Announce Type: new Abstract: On-policy distillation (OPD) has emerged as an effective framework for post-training language models by pairing student-generated trajectories with dense token-level supervision from a teacher.

By Chen Yang, Haiyuan Wan, Rengrong Xiong, Yize Chen, Danny H. K. Tsang

llms efficiency

arXiv Computation and Language

4d ago

Learning from Think-Mode Advantage via On-Policy Distillation

arXiv:2609.37044v1 Announce Type: new Abstract: Explicit intermediate reasoning gives large language models (LLMs) a stronger problem-solving mode. We study learning from this think-mode advantage vi...

By Wanqi Ren, Jianxiang Wang, Danxuan Liu, Linyi Ding, Yuan Zhang

llms efficiency

One email a morning, machine-written

Related stories

Skill-Conditioned Gated Self-Distillation for LLM Reasoning

Trajectory-Refined Distillation

OGLS-SD: On-Policy Self-Distillation with Outcome-Guided Logit Steering for LLM Reasoning

Localizing Credit at the Divergence: Path-Conditioned Self-Distillation for LLM Reasoning

Beyond Imitation: Filtering On-Policy Distillation by Reasoning Progress

Learning from Think-Mode Advantage via On-Policy Distillation