arXiv Computation and Language October 15, 2026 By Zile Yang, Ling Li, Na Di, Jinlong Pang, Yao Zhou, Hao Cheng, Bo Han, Jiaheng Wei

Reclaiming Low-Quality Instruction Data with Rule-Guided LLM Reconstruction

Read the original on arXiv Computation and Language →

The Flow has not summarised this story yet — read it at arXiv Computation and Language.

arXiv Machine Learning

Sep 2

Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation

arXiv:2609.01604v1 Announce Type: cross Abstract: LLM-based evaluators of natural language generation (NLG) quality are widely deployed as scoring tools and as automated training signals, yet the int...

By Himil Vasava, Ming Jiang

llms nlp fine-tuning

arXiv Machine Learning

Jul 24

DataPrep-Bench: Benchmarking LLMs as Training Data Preparators

arXiv:2607. 20465v1 Announce Type: new Abstract: The quality of training data fundamentally determines the capabilities of large language models (LLMs), yet no unified benchmark exists to measure how well LLMs, agents, and data-centric workflows actually prepare training data end to end.

By Hao Liang, Qifeng Cai, Yibo Lin, Jianzhuo Du, Qifeng Xia, Sizhe Qiu, Linzhuang Sun, Meiyi Qiang, Zhaoyang Han, Xiaochen Ma, Bohan Zeng, Ruichuan An, Conghui He, Wentao Zhang

llms agents fine-tuning benchmarks safety data-engineering

arXiv AI

Jul 10

UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing

arXiv:2607. 08646v1 Announce Type: cross Abstract: As available training data approaches its physical limit, gains from Scaling Laws have begun to diminish.

By Xinlong Zhao, Dongsheng Liu, Hengyu Zhao, Zixuan Fu, Zheng Wang, Jie Cai, Jie Zhou, Qiang Ma, Xuanhe Zhou, Xu Han, Yudong Wang, Zhiyuan Liu

llms safety

arXiv AI

Jun 2

RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting

arXiv:2606. 00147v1 Announce Type: cross Abstract: Domain-specific supervised fine-tuning (SFT) often improves in-domain performance at the cost of degrading a model's general capabilities.

By Yuduo Li, Xiaofeng Shi, Qian Kou, Longbin Yu, Hua Zhou

fine-tuning efficiency

Hugging Face Trending Papers

Sep 1

Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation

LLM-based evaluators of natural language generation (NLG) quality are widely deployed as scoring tools and as automated training signals, yet the internal procedure by which they assign a rating remai...

llms nlp fine-tuning

arXiv AI

Jun 2

SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision

arXiv:2606. 01139v1 Announce Type: new Abstract: Agent skills are procedural artifacts that enable LLM agents to execute workflows, verify constraints, and recover from failures.

By Yuxuan Liu, Zhaochen Su, Lingyun Xie, Yuhao Zhang, Qing Zong, Jiahe Guo, Zhongwei Xie, Yiyan Ji, Yauwai Yim, Hongyu Luo, Xiyu Ren, Ruan Chenyu, Haoran Li, Yangqiu Song

llms agents benchmarks

One email a morning, machine-written

Related stories

Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation

DataPrep-Bench: Benchmarking LLMs as Training Data Preparators

UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing

RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting

Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation

SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision