arXiv Computer Vision

MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing

MDN-Control is a training‑free framework for multi‑subject video editing that jointly controls target localization, occlusion geometry, and appearance initialization. It uses mask‑guided localization for consistent target placement, depth‑aware occlusion control to resolve boundaries between overlapping subjects, and noise‑latent prompting to retrieve Gaussian initializations from a noise library for prompt‑relevant priors. Experiments on MSVBench show that MDN‑Control achieves the lowest CM‑Err and the highest Q‑Edit while maintaining competitive text alignment and temporal consistency.

arXiv AI
1d ago

FacEDiT: Talking Head Video Editing via Facial Motion Infilling

FacEDiT is a mask‑controlled model for editing local segments of talking head videos by infilling facial motion from speech and surrounding context. It uses a self‑supervised pretext task that masks a motion span during training, enabling variable‑duration local rewriting while preserving identity, unedited regions, and boundary continuity. The authors also release FacEDiTBench, a benchmark covering diverse edit types and lengths, and demonstrate that FacEDiT achieves accurate, speech‑aligned edits with strong identity preservation and seamless transitions.

By Kim Sung-Bin, Joohyun Chang, David Harwath, Tae-Hyun Oh
arXiv Computer Vision
Oct 12

AV-FlowEdit: Training-Free Prompt-Driven Audio-Visual Editing with Event-Aware Spectral Trajectory Preservation

AV-FlowEdit is a training‑free, inversion‑free framework that enables prompt‑driven audio‑visual editing using joint audio‑video diffusion models. It leverages source‑to‑target flow differences to guide edits while preserving non‑target structure and cross‑modal correspondence. The method includes a Cross‑Modal Event‑Aware Spectral Trajectory Preservation module that suppresses drift by combining flow saliency, aligned audio activity, multiscale low‑frequency displacement, and diffusion‑stage scheduling, achieving strong prompt alignment, temporal consistency, and competitive audio quality.

By Shaohua Pan, Xiao Liu
arXiv Computer Vision
Sep 21

Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing

Edit‑VAR is a training‑free, inversion‑free framework that uses a pretrained visual autoregressive video model for text‑guided video editing. It encodes the source video into multi‑scale discrete tokens and applies probability‑guided conditional token replacement, attention‑guided token‑wise and scale‑aware modulation, and scale‑decoupled generation to preserve source appearance while enabling precise edits. The method also includes residual‑guided token pruning to reduce inference cost, and experimental results show it outperforms existing training‑free video editing methods in fidelity, source preservation, temporal coherence, and efficiency.

By Chongbo Zhao, Jiangming Wang, Xilai Wang, Xinyu Wang, Jingyi Tang, Chunjie Hao, Pengjie Song, Yue Ma