arXiv Machine Learning By Amogh Inamdar, Zhenwei Tang, Ashton Anderson, Richard Zemel

Level Up: Defining and Exploiting Transitional Problems for Curriculum Learning

Read the original on arXiv Machine Learning →

arXiv:2603. 13761v2 Announce Type: replace Abstract: Curriculum learning--ordering training examples in a sequence to aid machine learning--takes inspiration from human learning, but has not gained widespread acceptance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Aug 19

Understanding Curriculum Learning in Large Language Models via Cross-Difficulty Optimization Dynamics

The paper investigates why curriculum learning—ordering training data from easy to hard—varies in effectiveness across reasoning tasks. By studying optimization dynamics, the authors introduce Relative Transfer, a measure of cross‑difficulty knowledge transfer, and use it to create Transfer‑aware Dynamic Curriculum Sampling (TDCS). Experiments show TDCS outperforms existing scheduling strategies on multiple reasoning benchmarks, offering a unified optimization‑based explanation for curriculum learning.

By Zhikai Ding, Ziyi Ye