arXiv:2608. 20107v1 Announce Type: new Abstract: Recent advances in generative video models have significantly improved visual realism in video object removal, yet evaluation protocols still focus on masked region fidelity, treating removal as local inpainting.
By Yigit Ekin, Enes Sanli, Aykut Erdem, Erkut Erdem, Aysegul Dundar
arXiv:2610.20137v1 Announce Type: new
Abstract: Current video object removal methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction....
By Zhuobai Dong, Xiaobing Tu, Xiantao Zhang, Jinkui Ren, Yinggui Wang, Yue Ma, Linfeng Zhang
arXiv:2608.23549v1 Announce Type: new
Abstract: Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces...
By Khiem Vuong, Deva Ramanan, Srinivasa Narasimhan
Current video object removal methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction. We present StreamErase, enabling sub-second late...
SemantiScene-Edit is a video editing system that uses a multimodal encoder and a pretrained video diffusion transformer to follow natural‑language instructions while preserving the source video’s appearance and temporal structure. The encoder processes source frames and the instruction together, sending semantic queries to the generator via a trainable connector and cross‑attention. A dual‑path visual route concatenates source‑video latents with noisy target latents to provide dense spatial and temporal information, and the model is trained with flow matching and a three‑stage curriculum on over 1.2 million instruction‑conditioned records, with a 100‑case benchmark for evaluation.
By Xinyu Chen, Song Wu, Dingbao Shao, Jiahang Li, Jiang Lin, Yuhang Liu, Duo Li, Jiaxin Hu, Shengrong Gu, Liang Li, Qian Wang, Junlan Feng, Ying Tai, Jian Yang, Zili Yi
VINCIE‑NExT is a unified framework that transfers image editing capabilities to video editing by using in‑context visual demonstrations. It decomposes video editing into a chain of sub‑tasks (Video → Image → Image → Video), routing editing intent through the image domain and enabling joint training from heterogeneous image and video data under a single diffusion objective. The method introduces a novel position encoding to link image demonstrations and video frames, allowing pixel‑faithful appearance propagation, and supports test‑time scaling through progressive diffusion stages.
By Leigang Qu, Feng Cheng, Ziyan Yang, Bangbang Yang, Zhaoyang Huang, Wei Chow, Yicong Li, Wenjie Wang, Tat-Seng Chua, Yan Zeng
UniVOE is a removal‑driven framework that trains both video object removal and injection models. It first builds an effect‑aware remover by leveraging video inpainting priors and fine‑tuning on object‑present/object‑absent pairs, then uses the remover to generate large‑scale paired data for training an injection model that restores objects with their dynamics and interaction effects. A reward‑based post‑training step aligns injection results with human preferences, and experiments show UniVOE outperforms existing open‑source and commercial systems, especially in challenging interaction‑effect scenarios.
By Shuzhou Yang, Lanqing Guo, Lingen Li, Weiqi Li, Zhao Zhong, Liefeng Bo, Jian Zhang
arXiv:2506.01004v3 Announce Type: replace-cross
Abstract: Unlike traditional video editing or inpainting, video semantic mixing fuses a reference concept with a moving target entity to produce a hybr...
By Tong Zhang, Victor Escorcia, Juan C Leon Alcazar, Bernard Ghanem
Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces artifacts when input views are sparse or target v...
The paper introduces Sora100K, a dataset that captures AI‑Native video creation workflows as structured trajectories rather than isolated clips. It categorizes trajectories into text‑to‑video generation roots, single‑turn editing edges, and multi‑turn editing sequences, annotating each with semantic and operation labels via a VLM. A rigorous construction pipeline ensures accurate source‑to‑edit lineage and intermediate states, and lightweight adaptation on LTX‑2 models demonstrates improved visual quality, multi‑shot generation, and cross‑shot consistency, though multi‑turn editing remains challenging.
By Sicong Yang, Ruihuan Yang, Jian Lu, Jianfei Yuan, Xiaodong Cun, Xiuli Bi
Sparkle introduces a new dataset of approximately 140,000 video pairs for instruction‑guided background replacement, covering five common themes. The authors present a scalable pipeline that decouples foreground and background guidance with strict quality filtering, addressing the lack of precise background cues in existing data. Experiments show that models trained on Sparkle outperform all current baselines on both the OpenVE-Bench and the newly released Sparkle-Bench.
By Ziyun Zeng, Yiqi Lin, Guoqiang Liang, Mike Zheng Shou
arXiv:2607.18227v2 Announce Type: replace
Abstract: In line with the prevailing direction of vision research, we explore the integration of both generation and editing capabilities for video and imag...
By Dingyun Zhang, Lixue Gong, Wei Liu