arXiv Machine Learning July 31, 2026 By Jinliang Gao, Ning Yang, Hai Wang, Baili Xiao, Pin Lyu

SDO: Structure-Aware Data Organization for Efficient LLM Post-Training

Read the original on arXiv Machine Learning →

arXiv:2607. 27273v1 Announce Type: new Abstract: Post-training of large language models is expensive, and existing efficiency improvements mainly focus on selecting informative samples or designing training schedules.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 30

Coverage-Driven KV Cache Eviction for Efficient and Improved Inference of LLM

arXiv:2606. 29563v1 Announce Type: cross Abstract: Large language models (LLMs) excel at complex tasks like question answering and summarization, thanks to their ability to handle long-context inputs.

By Shuvendu Roy, Mengyao Zhai, Hossein Hajimirsadeghi, Golnoosh Samei

llms nlp efficiency

arXiv Computation and Language

3d ago

DataFlex: A Unified Framework for Data-Centric Dynamic Training of Large Language Models

arXiv:2603.26164v2 Announce Type: replace-cross Abstract: Data-centric training has emerged as a promising direction for improving large language models (LLMs) by optimizing not only model parameters...

By Hao Liang, Zhengyang Zhao, Mingrui Chen, Meiyi Qiang, Lu Ma, Rongyi Yu, Hengyi Feng, Shixuan Sun, Zimo Meng, Xiaochen Ma, Xuanlin Yang, Qifeng Cai, Ruichuan An, Bohan Zeng, Zhen Hao Wong, Chengyu Shen, Runming He, Zhaoyang Han, Yaowei Zheng, Fangcheng Fu, Conghui He, Bin Cui, Zhiyu Li, Weinan E, Wentao Zhang

llms rag benchmarks

arXiv AI

Jun 16

Utility-Diversity Aware Online Batch Selection for LLM Supervised Fine-tuning

arXiv:2510. 16882v4 Announce Type: replace-cross Abstract: Supervised fine-tuning (SFT) is a commonly used technique to adapt large language models (LLMs) to downstream tasks.

By Heming Zou, Yixiu Mao, Yun Qu, Qi Wang, Xiangyang Ji

llms rag fine-tuning benchmarks safety

arXiv Machine Learning

4d ago

UnlearningSoup: Is Repeated Tuning Necessary for Large Language Model Unlearning?

arXiv:2609.37076v1 Announce Type: new Abstract: Large language models trained on vast corpora inherently risk memorizing harmful content that may later re-emerge in their outputs. To mitigate this is...

By Puning Yang, Qizhou Wang, Junchi Yu, Bo Han, Xiuying Chen

llms

arXiv AI

4d ago

Adaptive Mass-Segmented KV Compression for Long-Context Reasoning

arXiv:2605.23200v2 Announce Type: replace-cross Abstract: The linear growth of the Key-Value (KV) cache is a critical bottleneck in long-form LLM inference. Existing KV compression methods mitigate t...

By Junzhe Yang, Xiaoyu Shen

llms efficiency

arXiv Machine Learning

Sep 14

Clustering-Based Balanced Sampling and Allocation with Data Parallelism for High-Performance Fine-Tuning

CluSTER is a cluster‑aware balanced sampling framework designed to improve the efficiency of instruction‑tuning for large language models. It reduces redundant computation by clustering data in gradient space and allocating samples across GPUs in a data‑parallel setting, while preserving the original distribution through weighted updates. Experiments show that CluSTER can cut training time by up to 69.6% with negligible loss in accuracy compared to existing sampling methods.

By Hyunjin Kim, Youngeun Nam, Jaemin Han, Wonhyeok Choi, Jae-Gil Lee

llms fine-tuning

One email a morning, machine-written

Related stories

Coverage-Driven KV Cache Eviction for Efficient and Improved Inference of LLM

DataFlex: A Unified Framework for Data-Centric Dynamic Training of Large Language Models

Utility-Diversity Aware Online Batch Selection for LLM Supervised Fine-tuning

UnlearningSoup: Is Repeated Tuning Necessary for Large Language Model Unlearning?

Adaptive Mass-Segmented KV Compression for Long-Context Reasoning

Clustering-Based Balanced Sampling and Allocation with Data Parallelism for High-Performance Fine-Tuning