arXiv AI
Jul 8

Few Channels Draw The Whole Picture: Revealing Massive Activations in Diffusion Transformers

arXiv:2605. 13974v2 Announce Type: replace-cross Abstract: Diffusion Transformers (DiTs) and related flow-based architectures are now among the strongest text-to-image generators, yet the internal mechanisms through which prompts shape image semantics remain poorly understood.

By Evelyn Turri, Davide Bucciarelli, Sara Sarto, Lorenzo Baraldi, Marcella Cornia
arXiv Computer Vision
6d ago

WithinVAE: Compact Visual Autoencoding with Self-Distilled Semantics

WithinVAE is a compact variational visual autoencoder that learns semantic structure internally using a sequential bottleneck and self‑distillation from an exponential‑moving‑average copy of itself. It achieves a four‑fold compression ratio on ImageNet‑1K, improving reconstruction metrics such as PSNR by 1.36 dB over RPiAE while using half the latent capacity. The model also boosts linear probing performance, demonstrating that semantic gains arise from self‑distillation rather than external supervision.

By Yuzhou Ji, Jiepeng Wang, Tianyu Jin, Lizhuang Ma, Haibin Huang, Chi Zhang, Xuelong Li
arXiv Computer Vision
Oct 16

FADRA: Frequency-Aware Diffusion with Residual Adaptation for Video Face Restoration

FADRA is a frequency‑aware diffusion framework designed for video face restoration (VFR). It combines a pre‑trained text‑to‑video diffusion model with lightweight LoRA adapters and a Low‑Quality Pixel‑Alignment Feature Fusion module to adapt the generative prior to VFR. The method introduces a Repeated Residual Adaptation Head that refines residuals step‑wise using low‑quality latent cues, and employs a Frequency‑Aware Loss to supervise multiple spectral bands, improving facial detail recovery and temporal consistency.

By Jin Jiang, Jia Wang, Panwen Hu, Weiran Zhao, Shengcai Liao
Hugging Face Trending Papers
Jul 7

FADRA: Frequency-Aware Diffusion with Residual Adaptation for Video Face Restoration

Video face restoration (VFR) aims to recover high-quality and temporally consistent facial details from severely degraded video sequences; however, existing methods still struggle to balance spatial fidelity and temporal coherence under complex degradations. To address this, we propose FADRA, a frequency-aware diffusion framework with iterative residual adaptation specifically tailored for robust VFR.