arXiv Machine Learning June 17, 2026 By Trisha Mittal, Akshay Mehra, Joshua Kimball

Rethinking Dataset Distillation for Classification: Do Distilled Sets Outperform Coresets?

Read the original on arXiv Machine Learning →

arXiv:2606. 18209v1 Announce Type: new Abstract: Dataset distillation (DD) has emerged as a prominent approach in data centric machine learning, aiming to synthesize compact training sets for efficient training by compressing the information in large datasets into a small number of synthetic samples.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 5

Unifying Dataset Pruning and Distillation for Efficient Large-scale Compression

arXiv:2502. 06434v2 Announce Type: replace-cross Abstract: Dataset pruning (DP) and dataset distillation (DD) fundamentally differ in their outputs: DP selects original image subsets, while DD generates synthetic images.

By Lingao Xiao, Songhua Liu, Yang He, Xinchao Wang

efficiency benchmarks

arXiv AI

Jun 30

FD$^2$: A Dedicated Framework for Fine-Grained Dataset Distillation

arXiv:2603. 25144v2 Announce Type: replace-cross Abstract: Dataset distillation (DD) compresses a large training set into a small synthetic set, reducing storage and training cost, and has shown strong results on general benchmarks.

By Hongxu Ma, Guang Li, Shijie Wang, Dongzhan Zhou, Baoli Sun, Takahiro Ogawa, Miki Haseyama, Zhihui Wang

efficiency benchmarks

arXiv Machine Learning

Jun 25

Distill on a Diet: Efficient Knowledge Distillation via Learnable Data Pruning

arXiv:2606. 25488v1 Announce Type: new Abstract: Knowledge Distillation (KD) is widely used to obtain compact models for efficient inference in resource-constrained environments.

By Yifan Wu, Yiqi Wang, Xichen Ye, Wenjing Yan, Xiaoqiang Li, Cheng Jin, Xiangyu Yue, Weizhong Zhang

efficiency

arXiv AI

Aug 11

TLDChoiceNet: Quantitatively Choosing a Transfer Learning Dataset

arXiv:2608. 09091v1 Announce Type: cross Abstract: Transfer learning is particularly useful in settings with limited training data, and within image classification it is common to transfer learn upon massive datasets like ImageNet , CIFAR-100, or COCO .

By Jing Ning, James D. Braza

rag computer-vision fine-tuning

arXiv AI

Jul 8

Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation

arXiv:2607. 05891v1 Announce Type: cross Abstract: Coreset selection aims to identify a small and highly representative subset of a massive dataset for efficient model training.

By Cemil-Andrei Dilmac, Florinel-Alin Croitoru, Radu Tudor Ionescu

llms computer-vision efficiency

arXiv AI

1d ago

Learning to Unlearn: Machine Unlearning via Learning the Unlearning Behaviors

arXiv:2608. 16700v1 Announce Type: cross Abstract: Various machine unlearning techniques have been developed in response to privacy legislation requirements, enabling individuals to exercise their legal right to have their data $D_f$ removed from a machine learning model.

By Hang Zhang, Kaifeng Zhang, Yixiao Ma, Weijie Xu, Ye Zhu, Kai Ming Ting

safety

Related stories

Unifying Dataset Pruning and Distillation for Efficient Large-scale Compression

FD$^2$: A Dedicated Framework for Fine-Grained Dataset Distillation

Distill on a Diet: Efficient Knowledge Distillation via Learnable Data Pruning

TLDChoiceNet: Quantitatively Choosing a Transfer Learning Dataset

Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation

Learning to Unlearn: Machine Unlearning via Learning the Unlearning Behaviors