arXiv Computer Vision August 28, 2026 By Cong Cao, Huanjing Yue, Xin Liu, Jingyu Yang

Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References

Read the original on arXiv Computer Vision →

The paper introduces a zero‑shot video restoration and enhancement framework that leverages a text‑to‑image latent diffusion model along with multi‑modal references. It employs dual prompt tuning inversion and sampling to cut inference time to about one‑third of the original, while also strengthening performance and temporal consistency. Additional techniques such as texture‑aware video token merging, referenced self‑attention, and referenced token merging further improve temporal coherence across frames.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI

1d ago

ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation

ContextAnyone is a context‑aware diffusion framework that treats a reference image as an explicitly preserved appearance anchor rather than a simple conditioning signal. By jointly reconstructing the reference image and generating the target video within a shared diffusion transformer, it provides direct supervision for maintaining identity and fine‑grained appearance throughout denoising. The method introduces asymmetric information flow and Gap‑RoPE positional representations to keep the reference stable while allowing selective access by video tokens, and demonstrates improved identity and appearance consistency on an OpenVid‑HD benchmark.

By Ziyang Mai, Yu-Wing Tai

llms diffusion benchmarks

arXiv Computer Vision

3d ago

DARD: Zero-Shot Degradation-Aware Retinex-Guided Diffusion for Low-Light Image Enhancement

arXiv:2608.29243v1 Announce Type: new Abstract: Existing diffusion-based enhancement methods provide strong generative capability for low-light image enhancement (LLIE), yet they either rely on paire...

By Wenjie Cai, Yuezhe Yang, Jianyang Xia, Xingbo Dong, Zhe Jin

diffusion computer-vision benchmarks

arXiv Computer Vision

Aug 24

DiffVC-ONE: Diffusion-based Generative Video Compression with One-Step Video Diffusion Transformer

arXiv:2608.20515v1 Announce Type: new Abstract: Generative video compression can recover rich visual details at low bitrates, but simultaneously achieving high temporal consistency and low inference...

By Wenzhuo Ma, Zhenzhong Chen

llms diffusion efficiency benchmarks

arXiv AI

Jul 24

ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editing

arXiv:2607. 21529v1 Announce Type: cross Abstract: Test-Time Tuning (TTT) on pretrained diffusion models has emerged as a powerful paradigm for video editing.

By Yueyi Liu, Chi Zhang, Sen Cui, Miao Liu

diffusion benchmarks

Hugging Face Trending Papers

Aug 12

Generative Video Compression Based on Hierarchical Referencing

Diffusion-based generative video compression has emerged as a promising paradigm to improve perceptual quality, where latent frames are required to be encoded efficiently while serving as denoising conditions. However, existing methods neither carefully design reference and quality structures during latent coding nor account for the impact of frame-level quality variation on denoising procedure, which limits coding efficiency and aggravates artifact propagation during generative reconstruction.

llms diffusion benchmarks

Hugging Face Trending Papers

Jul 7

FADRA: Frequency-Aware Diffusion with Residual Adaptation for Video Face Restoration

Video face restoration (VFR) aims to recover high-quality and temporally consistent facial details from severely degraded video sequences; however, existing methods still struggle to balance spatial fidelity and temporal coherence under complex degradations. To address this, we propose FADRA, a frequency-aware diffusion framework with iterative residual adaptation specifically tailored for robust VFR.

diffusion fine-tuning benchmarks safety