arXiv AI
Oct 9

VINCIE-NExT: Unlocking Video Editing from Images via In-Context Modeling

VINCIE‑NExT is a unified framework that transfers image editing capabilities to video editing by using in‑context visual demonstrations. It decomposes video editing into a chain of sub‑tasks (Video → Image → Image → Video), routing editing intent through the image domain and enabling joint training from heterogeneous image and video data under a single diffusion objective. The method introduces a novel position encoding to link image demonstrations and video frames, allowing pixel‑faithful appearance propagation, and supports test‑time scaling through progressive diffusion stages.

By Leigang Qu, Feng Cheng, Ziyan Yang, Bangbang Yang, Zhaoyang Huang, Wei Chow, Yicong Li, Wenjie Wang, Tat-Seng Chua, Yan Zeng
arXiv Computer Vision
Oct 9

Transforming Image Editors into Video Editors

The paper introduces Anchor-based Video Editing (AVE), a two-stage framework that converts a powerful image editor into a video editor by first editing keyframes and then propagating those edits across time using a motion-guided image-to-video diffusion model. AVE treats edited keyframes as fixed anchors, leveraging the strengths of modern image editors while avoiding costly end-to-end video training. Experiments on IVEBench and VIE-Bench demonstrate strong performance in instruction following, temporal consistency, and content fidelity, and ablations show that video quality correlates with the underlying image editor’s performance.

By Feng Wang, Zijie Li, Ceyuan Yang, Alan Yuille, Peng Wang
arXiv Computer Vision
Aug 25

EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing

EditStream is a unified DiT‑based framework that supports a wide range of interactive video tasks—Text‑to‑Video, Image‑to‑Video, Video‑to‑Video, Editing Propagation, Reference‑guided Video Editing, and Camera Pose Change—within a single system. It achieves fast, few‑step autoregressive generation by applying a two‑stage distillation process that combines Velocity Moment Matching with autoregressive unrolling, thereby preserving motion quality and temporal stability. The approach aims to make high‑quality diffusion‑based video models practical for real‑time creative workflows.

By Yuqian Zhou, Zhenghong Zhou, Zongze Wu, Cameron Smith, Richard Zhang, Jiebo Luo, Eli Shechtman, Zhe Lin