arXiv Computer Vision By Cong Cao, Huanjing Yue, Xin Liu, Jingyu Yang

Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References

Read the original on arXiv Computer Vision →

The paper introduces a zero‑shot video restoration and enhancement framework that leverages a text‑to‑image latent diffusion model along with multi‑modal references. It employs dual prompt tuning inversion and sampling to cut inference time to about one‑third of the original, while also strengthening performance and temporal consistency. Additional techniques such as texture‑aware video token merging, referenced self‑attention, and referenced token merging further improve temporal coherence across frames.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Sep 18

CleanVideo: Adaptive Concept Erasure for Text-to-Video Diffusion Models

CleanVideo introduces a selective erasure framework for text-to-video diffusion models, addressing the challenge of removing undesired visual concepts from videos. The method uses a low-dimensional subspace intervention guided by a tri-modal gating mechanism that jointly considers spatiotemporal visual features, timestep signals, and textual semantics to decide where, when, and whether to intervene. Experiments on three video diffusion models demonstrate that CleanVideo effectively erases target concepts while preserving visual fidelity, temporal coherence, and outperforming existing baselines in both frame-level and video-level evaluations, even under concept-recovery attacks.

By Junchi Liao, Hongji Li, Wenrui Zhou, Lijie Hu
arXiv AI
Sep 3

ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation

ContextAnyone is a context‑aware diffusion framework that treats a reference image as an explicitly preserved appearance anchor rather than a simple conditioning signal. By jointly reconstructing the reference image and generating the target video within a shared diffusion transformer, it provides direct supervision for maintaining identity and fine‑grained appearance throughout denoising. The method introduces asymmetric information flow and Gap‑RoPE positional representations to keep the reference stable while allowing selective access by video tokens, and demonstrates improved identity and appearance consistency on an OpenVid‑HD benchmark.

By Ziyang Mai, Yu-Wing Tai
arXiv AI
Sep 25

TOLA: Text-aware One-Step Latent Adaptation for Diffusion-based Text Image Super-Resolution

TOLA is a diffusion‑based text image super‑resolution method that eliminates iterative image‑text diffusion by using a one‑step latent adaptation framework. It employs a confidence‑weighted text conditioning module to build a reliable semantic condition and a lightweight latent residual correction module to fix structured residual errors, thereby preserving text fidelity. Experiments show TOLA outperforms existing diffusion‑based TSR methods, achieving at least 2.72 dB higher PSNR on the CTR‑TSR‑Test benchmark.

By Yike Xu, Yue Shi, Yong Guo, Jiezhang Cao