arXiv Computation and Language August 31, 2026 By Ridouane Ghermi, Xi Wang, Vicky Kalogeiton, Ivan Laptev

Long Story Short: Story-level Video Understanding from 20K Short Films

Read the original on arXiv Computation and Language →

The paper introduces Short‑Films 20K (SF20K), a large publicly available movie dataset comprising 20,143 amateur films totaling 3,582 hours, with an average length of 12 minutes per film. Accompanying the dataset is SF20K‑Test, a manual open‑ended question‑answering benchmark featuring 95 movies and 979 question‑answer pairs. Analysis of the benchmark shows limited data leakage, highlights the necessity of long‑term reasoning, and demonstrates that instruction tuning on the large‑scale dataset significantly boosts vision‑language model performance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computer Vision

Aug 27

Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding

The paper introduces Clue-OPSD, a clue‑privileged on‑policy self‑distillation framework that improves long‑video understanding by focusing on short, question‑relevant clue intervals rather than the entire video. Experiments on multiple benchmarks and Qwen3.5 model scales show that this approach consistently outperforms standard backbone models and competes strongly with supervised post‑training baselines, all while requiring fewer input frames and no additional inference modules.

By Kaishen Wang, Dongdi Zhao, Yijun Liang, Dingqiang Ye, Ruibo Chen, Heng Huang, Di Fu

llms efficiency multimodal benchmarks

arXiv AI

Jul 14

StoryTeller: Training-Free Narrative Grounding for Long-Form Audio Description

arXiv:2607. 11798v1 Announce Type: cross Abstract: Long-form audio description (AD) requires more than describing visible actions: it must preserve characters, events, relationships, and story context across scenes so that blind and low-vision (BLV) audiences can follow a film.

By Seung Hyun Hahm, Minh T. Dinh, SouYoung Jin

llms fine-tuning multimodal benchmarks

arXiv Computer Vision

Aug 24

Enhancing Localized Reasoning for Long Video Understanding via Efficient Segment-to-Video Supervision

arXiv:2608.20814v1 Announce Type: new Abstract: Though Multimodal Large Language Models (MLLMs) have shown impressive potential in video understanding, long video understanding (LVU) remains challeng...

By Beibei Zhang, Chao Xu, Jun Lan, Zongyi Li, Lai Wei, Huijia Zhu, Tongwei Ren

llms reinforcement-learning fine-tuning efficiency multimodal benchmarks

Hugging Face Trending Papers

Aug 26

Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding

Vision-language models (VLMs) have made substantial progress in long-video understanding, with standard backbone models typically answering questions from frames sampled across the full video. However...

llms efficiency multimodal benchmarks

arXiv AI

Jun 8

Watch, Remember, Reason: Human-View Video Understanding with MLLMs

arXiv:2606. 07433v1 Announce Type: cross Abstract: Video understanding is being rapidly transformed by multimodal large language models (MLLMs), as research moves from short clips to long, multimodal, and knowledge-intensive video scenarios.

By Jiahao Meng, Yue Tan, Qi Xu, Kuan Gao, Weisong Liu, Yanwei Li, Jason Li, Lingdong Kong, Haochen Wang, Qianyu Zhou, Jiangning Zhang, Guangliang Cheng, Yunhai Tong, Lu Qi, Minghsuan Yang

llms multimodal benchmarks safety

arXiv Computer Vision

3d ago

Beyond Visual Boundaries: Rethinking Scene Segmentation for Movie RAG

arXiv:2608.28699v1 Announce Type: new Abstract: Understanding long-form video remains a fundamental challenge for multimodal large language models (MLLMs). Sparse frame sampling fails to capture fine...

By Dong-Hee Kim, Seonwoo Choi, Changbeen Kim, Jungmyung Wi, Juyeon Ko, Youngju Choi, Il Hyeon Mun, Hyunwoo J. Kim, Donghyun Kim

llms rag computer-vision multimodal benchmarks

One email a morning, machine-written

Related stories

Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding

StoryTeller: Training-Free Narrative Grounding for Long-Form Audio Description

Enhancing Localized Reasoning for Long Video Understanding via Efficient Segment-to-Video Supervision

Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding

Watch, Remember, Reason: Human-View Video Understanding with MLLMs

Beyond Visual Boundaries: Rethinking Scene Segmentation for Movie RAG