arXiv AI

Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation

arXiv Computer Vision
6d ago

AVENUE: Audio-Video EditiNg Understanding and Evaluation

AVENUE is a new benchmark and evaluation framework for audio‑video editing that includes 1,291 source clips and 7,957 editing instructions covering audio‑targeted, video‑targeted, and coupled edits. It introduces a sample‑specific, modality‑aware evaluation that specifies the intended change and the content that must remain unchanged. The study applies this framework to joint, sequential, and separate editing models, revealing that existing models often alter unintended modalities, highlighting a key challenge in controllable AV editing.

By Hayeon Kim, Yoojin Jang, Jaejun Yoo
arXiv Computer Vision
Sep 3

OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editing

OmniEdit-Bench introduces a comprehensive benchmark for instruction-based video editing (IVE), addressing limitations of existing datasets by covering spatial, temporal, audio, and reference-based editing tasks and distinguishing explicit from implicit instructions. The evaluation framework assesses editing quality across accuracy, preservation, realism, and consistency, using human judgments and vision-language models, and incorporates an accuracy-aware penalty to ensure instruction fidelity. Experiments reveal that current IVE models perform poorly, highlighting the need for improved methods.

By Chenxuan Miao, Yutong Feng, Yi Lu, Yunfeng Yan, Donglian Qi, Shiwei Zhang, Yu Liu, Xi Chen, Hengshuang Zhao
arXiv Computer Vision
Aug 28

Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning

The paper introduces the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, aiming to enable consistent editing of long videos with multiple instructions. It proposes an agentic editing framework that combines Large Language Models and Vision-Language Models for shot-level decoupling and precise instruction parsing. The authors also present the MMLVE-Bench dataset and evaluation metrics, showing that their MMLVE-Agent outperforms existing state‑of‑the‑art methods by eliminating hallucinations and preserving temporal consistency.

By Chenyang Wu, Fuchen Long, Binyuan Huang, Xinlong Sun, Xi Chen, Chun-Le Guo, Chongyi Li
Hugging Face Trending Papers
Aug 27

Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning

The paper introduces the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, aiming to edit long videos with multiple instructions while maintaining consistency across shots, decoupling instructions, and preserving spatiotemporal structure. It proposes an agentic editing framework that combines Large Language Models and Vision‑Language Models for shot-level decoupling and precise instruction parsing. A new dataset, MMLVE‑Bench, and three evaluation metrics are created to benchmark this task, and experiments show the proposed MMLVE‑Agent outperforms existing closed‑source state‑of‑the‑art methods by eliminating hallucinations and ensuring seamless transitions.

Hugging Face Trending Papers
Aug 18

CoinVE-200K: A Large-Scale High-Quality Dataset for Compositional Instruction-Guided Video Editing

CoinVE-200K is a large, high‑quality dataset for compositional instruction‑guided video editing, featuring 1080p video‑editing pairs up to 201 frames long and containing 2–5 atomic editing operations per sample. The dataset covers diverse editing intents—targeting humans, objects, and backgrounds with addition, removal, modification, and stylization—while ensuring instruction faithfulness, visual quality, temporal consistency, and compositional diversity through a careful generation and filtering pipeline. CoinVE-Bench benchmarks these capabilities, and CoinVE-Edit, a 22B model built on Wan2.1‑T2V‑14B and Qwen3‑VL‑8B‑Instruct, demonstrates strong performance in instruction following, compositional editing accuracy, visual quality, and temporal consistency.

arXiv AI
Jul 28

FilmBench: A Film-Grade Benchmark for Cinematic Video Generation

arXiv:2607. 24241v1 Announce Type: cross Abstract: Progress in video generation keeps narrowing the visual gap between AI-generated and professionally produced footage, yet most benchmarks still draw prompts from web sources or LLM templates and score them with untrained, generic multimodal models.

By Shengyi Wang, Niantong Li, Guangzheng Hu, Hong Qi, Fei Ding, Weixu Qiao, Jinlin Wang, Xiaotong Lv, Peng Han, Zimeng Li, Fanshu Ding, Yushu Wang, Han Wu, Jingjing Chen, Chongxiao Wang, Yanhao Wu, Chenglong Huang, Xiaoqian Zhu, Jie Tian, Hua Li, Jingjing Fan, Mingshuang Tang, Zhong Li, Hengxia Qiang, Weibin Chen, Jinyang Zhen, Bing Zhao, Lin Qu, Jing Li, Hu Wei
Hugging Face Trending Papers
Jul 27

FilmBench: A Film-Grade Benchmark for Cinematic Video Generation

Progress in video generation keeps narrowing the visual gap between AI-generated and professionally produced footage, yet most benchmarks still draw prompts from web sources or LLM templates and score them with untrained, generic multimodal models. More fundamentally, their evaluation taxonomies remain rudimentary (overall visual quality, coarse text alignment and temporal smoothness) rather than the professional Cinematic Language criteria by which films are actually made and judged, so they assess basic video plausibility rather than film-grade craft.