arXiv Computation and Language September 11, 2026 By Teagan Johnson, Elliott Ash, Andrew Piper, Maria Antoniak

Characterizing Narrative Content in Web-scale LLM Pretraining Data

Read the original on arXiv Computation and Language →

The paper presents a detailed examination of narrative elements—agency, setting, and events—within the Dolma web-scale pretraining corpus. Using a framework of 11 interpretable dimensions, the authors hand‑annotated 400 passages, expanded this to a 25,000‑passage LLM‑labeled dataset, and trained NarraBERT models to predict narrative features across 13 million passages, producing the NarraDolma dataset. The study reveals that narrative structure is measurable at scale and that narrative qualities vary unevenly across different data sources, topics, and formats, highlighting gaps in current data curation practices.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

llms

arXiv AI

Jun 18

Narrative Theory-Driven LLM Methods for Automatic Story Generation and Understanding: A Survey

arXiv:2602. 15851v2 Announce Type: replace-cross Abstract: Applications of narrative theories using large language models (LLMs) deliver promising methods in automatic story generation and understanding tasks.

By David Y. Liu, Aditya Joshi, Paul Dawson

llms nlp benchmarks

arXiv Computation and Language

Sep 11

From Repetition to Recognition: Inductive Discovery of Disinformation Narratives

The paper introduces a three-tier evaluation framework—recovery, mining, and discovery—for unsupervised narrative label generation in disinformation datasets. It compares clustering-based and graph-community-based pipelines across seven datasets, finding that clustering can underrepresent prominent topics while graph methods produce many singletons that human annotators recognize as valid narratives. The authors release human-validated narrative candidate labels for the Climate Obstruction and PolyNarrative datasets to aid taxonomy development and dataset expansion.

By Max Upravitelev, Veronika Solopova, Jing Yang, Charlott Jakob, Alexandra Tsiakalou, Neda Foroutan, Vera Schmitt

arXiv AI

Jul 8

Narrative World Model: Narratology-Grounded Writer Memory for Long-Form Fiction

arXiv:2607. 05577v1 Announce Type: new Abstract: Long-form fiction writers need memory that answers multi-hop questions about evolving story state: who knows a secret and when they learned it, whether an event preceded the narration that revealed it, whether a setup paid off, and how a relationship shifted.

By Mohammad Saifullah, Thomas Kornmaier, Taaha Kazi, Vasu Sharma, Aditya Sanjiv Kanade, Aanand Kumar Yadav

agents benchmarks

arXiv AI

Jun 17

Do Large Language Models Always Tell The Same Stories?

arXiv:2606. 17350v1 Announce Type: cross Abstract: Recent advances in large language models (LLMs) have enabled the generation of high-quality prose, yet the question of whether these models are capable of generating diverse outputs remains contested.

By Thennal DK, Hans Ole Hatzel

llms

arXiv AI

Jun 6

Narrative Knowledge Weaver: Narrative-Centric Retrieval-Augmented Reasoning for Long-Form Text Understanding

arXiv:2606. 05724v1 Announce Type: cross Abstract: Long-form narrative QA requires reasoning over evolving story worlds rather than isolated passages: answers may depend on earlier goals, changing character states, social relations, causal triggers, temporal position, and later consequences.

By Qiuyu Tian, Fengyi Chen, Yiding Li, Youyong Kong, Fan Guo, Yuyao Li, Jinjing Shen, Zhijing Xie, Yiyun Luo, Xin Zhang, Yingce Xia, Zequn Liu

rag benchmarks

arXiv AI

Sep 10

LitSeg: Narrative-Aware Document Segmentation for Literary RAG

arXiv:2605.27156v2 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external knowledge, particularly for long-tail do...

By Ruikang Zhang, Zhanni Chen, Yiqiao Cai, Qi Su

llms rag computer-vision fine-tuning efficiency benchmarks

One email a morning, machine-written

Related stories

Narrative Theory-Driven LLM Methods for Automatic Story Generation and Understanding: A Survey

From Repetition to Recognition: Inductive Discovery of Disinformation Narratives

Narrative World Model: Narratology-Grounded Writer Memory for Long-Form Fiction

Do Large Language Models Always Tell The Same Stories?

Narrative Knowledge Weaver: Narrative-Centric Retrieval-Augmented Reasoning for Long-Form Text Understanding

LitSeg: Narrative-Aware Document Segmentation for Literary RAG