arXiv AI
Oct 5

DAGS: Disentangled Appearance-and-Geometry Steering of a Frozen Image DiT for Temporally Stabilized Generative Rendering

DAGS introduces a lightweight, attention‑free conditioning scheme that disentangles appearance and geometry for a frozen image diffusion transformer (DiT), enabling high‑fidelity, temporally stable renders with independent control. Two small convolutional encoders generate per‑frame conditioning features, which are injected as learned residuals into the image tokens, avoiding the quadratic cost of attention. Coupled with a recurrent lighting stabilizer and a training‑free temporal guidance term, DAGS transforms a per‑frame image model into a streaming renderer that outperforms real‑time denoisers and diffusion renderers in PSNR and temporal stability while requiring far less compute than path tracing.

By Karthik Mohan Kumar, Damian Andrysiak, Pedro Antonio Pena, Kunal Tyagi, Rama Harihara
arXiv AI
Jul 24

RealVDeblur: One-Step Diffusion for Generalizable Real-World Video Deblurring

arXiv:2607. 20628v1 Announce Type: cross Abstract: Real-world video deblurring remains challenging due to diverse motion patterns, complex degradations, and the scarcity of realistic training data, yet robust restoration is critical for downstream pipelines such as mobile imaging and 3D reconstruction.

By Renbiao Jin, Mingxin Yang, Yutian Chen, Junhao Zhuang, Xin Cai, Mulin Yu, Linning Xu, Wenxian Yu, Danping Zou, Shi Guo, Tianfan Xue
arXiv Computer Vision
Aug 25

Controllable blind deblurring with diffusion models

The paper introduces SuperSharpen, a diffusion-based method for blind deblurring in professional photography that can invert unknown isotropic blur without knowing the degradation kernel. It offers explicit control over restoration strength via a blur measure and compares two conditioning strategies: a ControlNet-style adapter on a frozen backbone and full finetuning of the diffusion prior. Experiments on synthetic and real-world blur show that finetuning yields higher fidelity with fewer hallucinated details, improving perceptual quality and controllable restoration strength.

By Imane Si Salah, Emile Cribelier, Thomas Veit, Wolf Hauser, Arthur Leclaire
arXiv AI
Oct 2

PickMoment: Continuous-Time Single-Image-to-Video via Learning Deblurring and Blur-to-Video

PickMoment is a continuous‑time model that learns to predict the interval‑mean blur over arbitrary sub‑intervals of a camera exposure, unifying single‑image deblurring, blur‑to‑video generation, and continuous‑time pick‑a‑moment recovery. It is trained with three supervisions derived from the blur integral: an empirical reconstruction loss, an additivity loss for self‑consistency, and a sharp‑frame loss at zero interval. The model achieves state‑of‑the‑art performance on GoPro and HIDE for generative deblurring, competitive results on RealBlur, and the highest per‑frame fidelity on GoPro‑7 blur‑to‑video, all in a single forward pass.

By Junseong Shin, Hyeonsu Jo, Daehyun Kim, Tae Hyun Kim