arXiv AI
Is Human-Readable Text Necessary for Effective LLM Fine-Tuning?
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jun 10
PromptEmbedder: Efficient and Transferable Text Embedding via Dual-LLM Soft Prompting
arXiv:2605. 28066v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated remarkable efficacy in text embedding, yet current adaptation methods like LoRA face significant bottlenecks in computational efficiency and cross-architecture transferability.
arXiv Machine Learning
Jul 31
How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data
arXiv:2604. 13977v2 Announce Type: replace-cross Abstract: Synthetic data is a standard component in training large language models, yet systematic comparisons across design dimensions, including rephrasing strategy, generator model, and source data, remain absent.
arXiv Machine Learning
2d ago
It's All Training: A Fully Synthetic Single-Stage Recipe for LLMs
arXiv:2609.37891v1 Announce Type: cross Abstract: Current pre-training datasets are derived from web crawls, with all their issues, and were not designed to support mid- and post-training pipelines--...
arXiv Computation and Language
Aug 21
EvoSelect: Data-Efficient LLM Evolution for Targeted Task Adaptation
arXiv:2604. 26170v2 Announce Type: replace Abstract: Adapting large language models (LLMs) to a targeted task efficiently and effectively remains a fundamental challenge.
arXiv Computation and Language
Sep 22
Want Better Synthetic Data? Steer It: Activation Steering for Low-Resource Language Generation
arXiv:2606.18389v2 Announce Type: replace Abstract: Large language models (LLMs) have become an effective tool for synthetic data generation, including for low-resource languages, where generated dat...
arXiv AI
Jul 21
Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoning
arXiv:2505. 20161v2 Announce Type: replace-cross Abstract: Effective generalization in language models depends critically on the diversity of their training data.