arXiv AI

Attention Flows: Tracing LLM Conceptual Engagement via Story Summaries

The paper investigates how large language models (LLMs) engage with long-form narratives by comparing their generated novel summaries to human-authored ones. Researchers align sentences from 150 human-written summaries to specific chapters, highlighting the challenge of this alignment task and the complexity of summarization. They find stylistic differences and that LLMs tend to focus more on the ends of texts, suggesting insights into why models may struggle with narrative comprehension.

arXiv AI
Sep 2

Value Over Language Model: Detecting Original Contribution in Writing

The paper introduces VOLM, a framework that quantifies how much original value a human adds to a document beyond what a language model could generate from a task description alone. Unlike existing tools that focus on stylistic detection, VOLM extracts content at varying granularities, reconstructs it with an LLM, and compares these reconstructions to those derived from the task description. Evaluations across news articles, ICLR peer reviews, and argumentative essays show that VOLM can distinguish human-authored texts from LLM-generated ones while remaining robust to content-preserving transformations.

By Vibhhu Sharma, Thorsten Joachims, Sarah Dean
arXiv AI
Jun 9

Summarization is Not Dead Yet

arXiv:2606. 08000v1 Announce Type: cross Abstract: The progress of large language models (LLMs) has fueled claims that model-generated summaries rival or even surpass human-written references, raising questions about whether summarization remains an open research problem.

By Dongqi Liu, Chenxi Whitehouse, Zheng Zhao, Zhuchen Cao, Jian Li, Yabiao Wang
arXiv Computation and Language
Sep 11

Characterizing Narrative Content in Web-scale LLM Pretraining Data

The paper presents a detailed examination of narrative elements—agency, setting, and events—within the Dolma web-scale pretraining corpus. Using a framework of 11 interpretable dimensions, the authors hand‑annotated 400 passages, expanded this to a 25,000‑passage LLM‑labeled dataset, and trained NarraBERT models to predict narrative features across 13 million passages, producing the NarraDolma dataset. The study reveals that narrative structure is measurable at scale and that narrative qualities vary unevenly across different data sources, topics, and formats, highlighting gaps in current data curation practices.

By Teagan Johnson, Elliott Ash, Andrew Piper, Maria Antoniak
arXiv Computation and Language
Sep 3

CARPAS: Towards Content-Aware Refinement of Provided Aspects for Summarization in Large Language Models

The paper introduces CARPAS, a new task that dynamically refines user-provided aspects for aspect-based summarization in large language models (LLMs). It presents three new datasets and evaluates four prompting strategies, finding that LLMs tend to over-generate aspects, leading to overly long and misaligned summaries. To address this, the authors propose a two-stage framework that first generates lightweight scope guidance before aspect refinement and summarization, which improves focus, reduces over-generation, and enhances performance across all datasets.

By Yong-En Tian, Yu-Chien Tang, An-Zi Yen, Wen-Chih Peng
arXiv Computation and Language
Sep 14

The House with a Million Windows: Interactive Fiction for Narrative Restorying

The House with a Million Windows (HWAMW) is an LLM-based interactive fiction system that lets users narrate a story and then view it through a series of AI-generated "windows" that reframe the narrative in various literary styles. The system is grounded in the psychological restorying intervention, aiming to deepen users' exploration of meaning in their personal stories. Empirical results indicate that HWAMW enhances users' sense of narrative identity, and expert reviews suggest it achieves this by facilitating restorying rather than simply generating new content.

By Cody Kommers, Sarah G Immel, Drew Hemment, Mina Lee
arXiv AI
Jul 22

PlotTwist: A Creative Plot Generation Framework with Small Language Models

arXiv:2603. 16410v2 Announce Type: replace-cross Abstract: Creative plot generation presents a fundamental challenge for language models: transforming a concise premise into a coherent narrative that sustains global coherence, character development, pacing, tone consistency, and emotional progression.

By Abhinav Thorat, Ravi Kolla, Jyotin Goel, Madhav Kataria, Niranjan Pedanekar