arXiv AI By Hoang-Chau Luong, Lingwei Chen

Rethinking the Role of Temperature in Large Language Model Distillation

Read the original on arXiv AI →

arXiv:2606. 00306v1 Announce Type: cross Abstract: Reverse Kullback-Leibler (RKL) divergence is widely favored over forward KL (FKL) in large language models (LLM) distillation, yet this preference is largely based on comparisons that omit the temperature $\tau$, overlooking its central role in softening teacher distributions and improving knowledge transfer.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

arXiv Machine Learning
Jun 2

Internalize the Temperature: On-Policy Self-Distillation as Policy Reheater for Reinforcement Learning

arXiv:2606. 00755v1 Announce Type: cross Abstract: Reinforcement learning from verifiable rewards improves the reasoning ability of large language models, but often suffers from entropy collapse, in which increasingly concentrated policies reduce rollout diversity and useful learning signals.

By Xuewei Yang, Jiachen Yu, Jie Wu, Shaoning Sun, Junjie Wang, Yujiu Yang