arXiv Computation and Language

Extracting Arguments, Not Just Classifying Them: Instruction-Tuned LLMs for Generative Component Detection

arXiv Computation and Language
Sep 23

Designing and Analysing Argument Mining Pipelines: Towards a Comprehensive Assessment

The paper introduces a meta‑study that reviews state‑of‑the‑art end‑to‑end argument mining (AM) pipelines. It proposes a triple‑perspective framework—linguistic, computational, and domain—to analyze how these pipelines model, compute, and incorporate domain knowledge into argument structures. The authors also outline a general design for the linguistic and computational aspects, aiming to standardize methodology descriptions and enable clearer comparisons among AM approaches.

By Siddharth Bhargava, Sara Tonelli, Patricia Mart\'in-Rodilla
arXiv Computation and Language
4d ago

Layer-Informed Fine-Tuning via Three-Stage Functional Segmentation of LLMs

The paper proposes Layer-Informed Fine-Tuning (LIFT), a method that identifies and updates only the most functionally critical layers of large language models (LLMs) using a bottleneck identification mechanism based on sensitivity analysis. By focusing on layers that handle conceptualization, reasoning, and textualization, LIFT aims to accelerate training and enhance performance on reasoning tasks. Experiments demonstrate that this selective fine-tuning approach both speeds up the training process and yields significant performance gains.

By Junning Shao, Siwei Wang, Zhixuan Fang
arXiv Computation and Language
Aug 31

Learning a Single Token to Replace Long System Prompts in LLMs

arXiv:2511.23271v2 Announce Type: replace Abstract: Long system prompts are widely used to steer Large Language Models (LLMs), but repeatedly processing them at inference time is inefficient and cons...

By Jiancheng Dong, Pengyue Jia, Jingyu Peng, Maolin Wang, Yuhao Wang, Lixin Su, Xin Sun, Shuaiqiang Wang, Dawei Yin, Xiangyu Zhao
arXiv Machine Learning
Aug 28

A Survey of LLM Prompt Datasets: Taxonomy, Linguistic Patterns, and Practical Uses

The paper presents a survey of 129 public large language model (LLM) prompt datasets, totaling over 1.22 TB and 673 million instances, and introduces a unified taxonomy for them. By analyzing seven datasets in depth, the authors identify lexical, syntactic, and semantic patterns that differentiate prompts from general text, and evaluate these patterns for tasks such as prompt filtering, source domain routing, and response quality assessment. They demonstrate that a 63‑dimensional linguistic feature set extracted on a CPU can match over 91 % of the F1 score of GPU‑based sentence embeddings while halving latency, and that structural features can effectively route prompts across datasets, though they may negatively impact response quality when prompt length is controlled.

By Yuanming Zhang, Yan Lin, Arijit Khan, Huaiyu Wan