arXiv Computation and Language By Yo Ehara

Flesch-Kincaid Readability Depends Only on the Topic Distribution in Long Texts under Topic Models

Read the original on arXiv Computation and Language →

The paper shows that the Flesch Reading Ease and Flesch‑Kincaid Grade Level scores, which are computed from the same two document statistics, converge almost surely to deterministic functions of a document’s topic distribution when modeled with a topic model that includes explicit sentence boundaries. In the long‑text limit, all variation in these scores is driven solely by topical composition, not by any residual readability signal. Experiments on the Brown and BNC corpora demonstrate that a topic vector inferred from one half of a document can predict the other half’s FKGL with substantial correlation (r = 0.779 and 0.884), though adding this prediction to genre and syllable‑count features yields only marginal gains in explained variance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
6d ago

The Divergence Hypothesis: Unmasking Lexical Interference and Label Bias in Mental Health NLP

The paper introduces TSS (Triple-Stream Stress probe), a diagnostic framework that splits text into lexical, morpho-syntactic, and psycholinguistic style channels to analyze mental health NLP classifiers. Across four English datasets, TSS uncovers a lexical interference effect where adding lexical features harms performance on human-labeled data but not on auto-labeled data, and proposes the Degree of Divergence (DoD) statistic to audit label-source bias. The study demonstrates that style features largely remain effective even after masking content words, emphasizing that shortcut learning is label-source specific rather than clinically relevant.

By Moustafa Yehia Hassan
arXiv AI
Jul 24

Response drift across frontier large language models

arXiv:2607. 20454v1 Announce Type: cross Abstract: All frontier large language models (LLMs) exhibit response drift -- producing outputs that deviate from expert-validated references -- yet the magnitude and structure of this drift remain uncharacterised by systematic human evaluation.

By Mohammed Aledhari, Ali Aledhari, Fatimah Aledhari, Gowtham Venkat Eathamokkala, Mohamed Rahouti
Hugging Face Trending Papers
Aug 3

Floor, Ceiling, and the Fusion Gap: How Much of Crowd Reading Attention Can Machines Predict?

A benchmark score means nothing without knowing what a trivial method achieves and what the best possible method could achieve. We construct both bounds for a task with a rare kind of ground truth: predicting which sentences a crowd of readers -- highlighting for their own purposes, unpaid, uninstructed, and blind to each other -- marked in 120 web documents.