arXiv AI
Training-Aware Target Coverage for Synthetic Data Selection
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 7
Post-Generation Curation of Synthetic Images via Homogeneous-Heterogeneous Splitting
arXiv:2607. 02637v1 Announce Type: cross Abstract: Recent generative models can produce high-quality synthetic images, offering scalable training training data for data-hungry models.
arXiv Machine Learning
Aug 19
Data-DPO: Direct Preference Optimization for Target Model Data Selection in LLM Post-Training
Data-DPO is a target model‑oriented supervised fine‑tuning data selection method that uses one‑step probing of the target model to generate pairwise data preferences, trains a lightweight reward model to capture these preferences, and then selects a training subset by combining target‑model preference, external quality scores, and marginal diversity. Experiments on Vision‑Flan and LLaVA‑CoT demonstrate that Data‑DPO consistently outperforms existing data selection baselines across multiple data budgets and even surpasses full data training performance.
arXiv Computation and Language
Aug 21
EvoSelect: Data-Efficient LLM Evolution for Targeted Task Adaptation
arXiv:2604. 26170v2 Announce Type: replace Abstract: Adapting large language models (LLMs) to a targeted task efficiently and effectively remains a fundamental challenge.
arXiv Machine Learning
Aug 13
Epiplexity Guided Data Selection and Generation for Out-of-Distribution Generalization
arXiv:2608. 11746v1 Announce Type: new Abstract: Modern systems are increasingly expected to transfer across tasks not specified during training.
arXiv Machine Learning
Jun 16
Discriminative Span as a Predictor of Synthetic Data Utility via Classifier Reconstruction
arXiv:2605. 09697v3 Announce Type: replace-cross Abstract: In many real-world computer vision applications, including medical imaging and industrial inspection, binary classification tasks are characterized by a severe scarcity of positive samples.
arXiv Statistics ML
Sep 10
Learning with Synthetic Data via SGD in High-Dimensional Linear Regression
arXiv:2609.09572v1 Announce Type: new Abstract: Synthetic data has become a promising way to scale model training beyond limited human-generated data but it may also induce strong model collapse (Doh...