← Back to all news
arXiv Computer Vision By Jiayi Yu, Xi Ye, Lina Wang, Yunkun Xia

MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing

Read the original on arXiv Computer Vision →

MDN-Control is a training‑free framework for multi‑subject video editing that jointly controls target localization, occlusion geometry, and appearance initialization. It uses mask‑guided localization for consistent target placement, depth‑aware occlusion control to resolve boundaries between overlapping subjects, and noise‑latent prompting to retrieve Gaussian initializations from a noise library for prompt‑relevant priors. Experiments on MSVBench show that MDN‑Control achieves the lowest CM‑Err and the highest Q‑Edit while maintaining competitive text alignment and temporal consistency.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv AI
1d ago

FacEDiT: Talking Head Video Editing via Facial Motion Infilling

FacEDiT is a mask‑controlled model for editing local segments of talking head videos by infilling facial motion from speech and surrounding context. It uses a self‑supervised pretext task that masks a motion span during training, enabling variable‑duration local rewriting while preserving identity, unedited regions, and boundary continuity. The authors also release FacEDiTBench, a benchmark covering diverse edit types and lengths, and demonstrate that FacEDiT achieves accurate, speech‑aligned edits with strong identity preservation and seamless transitions.

By Kim Sung-Bin, Joohyun Chang, David Harwath, Tae-Hyun Oh
benchmarkssafety
More like this →
arXiv Computer Vision
Oct 12

AV-FlowEdit: Training-Free Prompt-Driven Audio-Visual Editing with Event-Aware Spectral Trajectory Preservation

AV-FlowEdit is a training‑free, inversion‑free framework that enables prompt‑driven audio‑visual editing using joint audio‑video diffusion models. It leverages source‑to‑target flow differences to guide edits while preserving non‑target structure and cross‑modal correspondence. The method includes a Cross‑Modal Event‑Aware Spectral Trajectory Preservation module that suppresses drift by combining flow saliency, aligned audio activity, multiscale low‑frequency displacement, and diffusion‑stage scheduling, achieving strong prompt alignment, temporal consistency, and competitive audio quality.

By Shaohua Pan, Xiao Liu
diffusionmultimodalsafety
More like this →