arXiv AI
Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computer Vision
Sep 7
AVENUE: Audio-Video EditiNg Understanding and Evaluation
AVENUE is a new benchmark and evaluation framework for audio‑video editing that includes 1,291 source clips and 7,957 editing instructions covering audio‑targeted, video‑targeted, and coupled edits. It introduces a sample‑specific, modality‑aware evaluation that specifies the intended change and the content that must remain unchanged. The study applies this framework to joint, sequential, and separate editing models, revealing that existing models often alter unintended modalities, highlighting a key challenge in controllable AV editing.
arXiv Computer Vision
Sep 3
OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editing
OmniEdit-Bench introduces a comprehensive benchmark for instruction-based video editing (IVE), addressing limitations of existing datasets by covering spatial, temporal, audio, and reference-based editing tasks and distinguishing explicit from implicit instructions. The evaluation framework assesses editing quality across accuracy, preservation, realism, and consistency, using human judgments and vision-language models, and incorporates an accuracy-aware penalty to ensure instruction fidelity. Experiments reveal that current IVE models perform poorly, highlighting the need for improved methods.
arXiv Computer Vision
Aug 28
Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning
The paper introduces the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, aiming to enable consistent editing of long videos with multiple instructions. It proposes an agentic editing framework that combines Large Language Models and Vision-Language Models for shot-level decoupling and precise instruction parsing. The authors also present the MMLVE-Bench dataset and evaluation metrics, showing that their MMLVE-Agent outperforms existing state‑of‑the‑art methods by eliminating hallucinations and preserving temporal consistency.
Hugging Face Trending Papers
Aug 27
Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning
The paper introduces the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, aiming to edit long videos with multiple instructions while maintaining consistency across shots, decoupling instructions, and preserving spatiotemporal structure. It proposes an agentic editing framework that combines Large Language Models and Vision‑Language Models for shot-level decoupling and precise instruction parsing. A new dataset, MMLVE‑Bench, and three evaluation metrics are created to benchmark this task, and experiments show the proposed MMLVE‑Agent outperforms existing closed‑source state‑of‑the‑art methods by eliminating hallucinations and ensuring seamless transitions.
arXiv Computer Vision
Oct 9
From Video Clips to Creation Trajectory: Sora100K for AI-Native Video Creation
The paper introduces Sora100K, a dataset that captures AI‑Native video creation workflows as structured trajectories rather than isolated clips. It categorizes trajectories into text‑to‑video generation roots, single‑turn editing edges, and multi‑turn editing sequences, annotating each with semantic and operation labels via a VLM. A rigorous construction pipeline ensures accurate source‑to‑edit lineage and intermediate states, and lightweight adaptation on LTX‑2 models demonstrates improved visual quality, multi‑shot generation, and cross‑shot consistency, though multi‑turn editing remains challenging.
arXiv AI
Jun 9
CoVEBench: Can Video Editing Models Handle Complex Instructions?
arXiv:2606. 08415v1 Announce Type: cross Abstract: While recent text-guided video editing models excel at elementary tasks (e.