arXiv Computation and Language
Sep 4

The Impact of Synthetic Data Augmentation on Discourse-Pragmatic Function Classification

The study examines how the geometric placement of synthetic data affects discourse‑pragmatic function classification. Using 410 annotated instances of the word "look" from the British National Corpus, synthetic examples were generated with Llama 3.1 and grouped by cosine distance from real data in RoBERTa space. Six training conditions were compared, showing that examples close to real data (NEAR) yield the largest macro‑F gain, while a distance‑balanced mix gives the highest accuracy, yet none improve AUC.

By Sara Sorahi, Kevin Tang, Reza Kazemian
arXiv Computation and Language
2d ago

A Systematic Analysis of Linguistic Features in AI-Generated English Text Detection Across Domains and Models

The paper presents a large‑scale empirical study of 284 interpretable linguistic features to detect AI‑generated English text across 30 language models and 10 text domains. It finds that classifiers using only linguistic features can reliably distinguish machine‑from human‑written text, but most indicators are highly context‑dependent. Only lexical richness measures consistently generalize across model families and domains, offering robust signals for detection.

By Yassir El Attar, Esra D\"onmez, Maximilian Maurer, Agnieszka Falenska
Hugging Face Trending Papers
Sep 3

The Impact of Synthetic Data Augmentation on Discourse-Pragmatic Function Classification

The study examines how the geometric placement of synthetic data affects discourse-pragmatic function classification. Using 410 annotated instances of the word "look" and synthetic examples generated by Llama 3.1, the authors partitioned the synthetic data by cosine distance in RoBERTa space and compared six training conditions. While all augmentation conditions improved macro‑F and accuracy over a real‑only baseline, the nearest synthetic examples (NEAR) yielded the largest macro‑F gain (0.113) and a distance‑balanced mix achieved the highest accuracy (0.748), though none improved AUC.