arXiv:2609.38406v1 Announce Type: new Abstract: Access to real-world information is often noisy and fragmented. Constructing a coherent narrative from such fragments requires models to reconstruct mi...
The paper presents a detailed examination of narrative elements—agency, setting, and events—within the Dolma web-scale pretraining corpus. Using a framework of 11 interpretable dimensions, the authors hand‑annotated 400 passages, expanded this to a 25,000‑passage LLM‑labeled dataset, and trained NarraBERT models to predict narrative features across 13 million passages, producing the NarraDolma dataset. The study reveals that narrative structure is measurable at scale and that narrative qualities vary unevenly across different data sources, topics, and formats, highlighting gaps in current data curation practices.
arXiv:2606. 27598v1 Announce Type: cross Abstract: Ultra-fine entity typing (UFET) assigns highly specific types to entity mentions, but current approaches struggle with types in the long tail.
arXiv:2602. 15851v2 Announce Type: replace-cross Abstract: Applications of narrative theories using large language models (LLMs) deliver promising methods in automatic story generation and understanding tasks.
The study examines how varying the context window size of GPT‑2 affects its alignment with human reading-time data. A U‑shaped relationship is found: very short windows (<20 tokens) capture local memory limits, while larger windows (500–1,000 tokens) provide the best overall fit. Counterfactual experiments that disrupt cross‑sentential coreference chains show that these long‑range coreference relations are crucial for the improved fit of larger context windows.
arXiv:2606. 17350v1 Announce Type: cross Abstract: Recent advances in large language models (LLMs) have enabled the generation of high-quality prose, yet the question of whether these models are capable of generating diverse outputs remains contested.
arXiv:2603.18007v2 Announce Type: replace-cross Abstract: The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to inf...
arXiv:2606. 05553v1 Announce Type: cross Abstract: Role-playing language agents (RPLAs) should play characters whose values and behavior evolve as the story progresses, not maintain a fixed persona.
arXiv:2601. 17226v2 Announce Type: replace-cross Abstract: Counterfactual story retelling exposes LLM shortcomings in constrained narrative solution spaces where they can no longer rely on recalling memorised training data.
arXiv:2601. 01095v3 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved impressive progress in vision-language reasoning, yet their ability to understand temporally unfolding narratives in videos remains underexplored.
arXiv:2606. 26880v1 Announce Type: cross Abstract: Language-model representations provide structured, high-dimensional annotations of naturalistic language stimuli and can serve as informative neural predictors during comprehension.
The study investigates how language models track entities across discourse, comparing them to human performance using naturalistic narratives. It finds that humans experience a decline in entity tracking only with increased narrative complexity, not length. Remarkably, language models with as few as 410 million parameters already match human-level tracking, and larger models surpass human performance, indicating that this core linguistic skill emerges at smaller scales than previously believed.