arXiv Computer Vision

Bridging Restoration and Generation in One-step Diffusion for Real-World Image Super-Resolution

arXiv Computer Vision
Sep 3

SelfLift: Accelerating Few-Step Diffusion via Self-Recovering Resolution Transition

SelfLift is a progressive‑resolution framework that accelerates few‑step diffusion models by enabling late, self‑recovering transitions between low‑ and high‑resolution latents. It introduces a training‑free Artifact‑Aware Consistency Lift that uses disagreement between direct latent lifting and pixel‑VAE re‑encoding to detect and correct artifacts, and a self‑recovery policy that transfers high‑resolution guidance from an internal teacher. Experiments on FLUX.2‑Klein and Z‑Image‑Turbo show latency reductions of 41.5% and 44.1%, and overall speedups of 29.61× and 19.21× over 50‑step baselines while maintaining competitive generation quality.

By Tingyan Wen, Chenqian Yan, Xurui Peng, Xiazhang Fang, Shuai Wang, Xueqian Wang, Songwei Liu
arXiv Machine Learning
Jun 29

StableMotion: One-Step Motion Estimation with Diffusion Prior

arXiv:2505. 06668v2 Announce Type: replace-cross Abstract: We present StableMotion, a novel framework that leverages geometric and content priors from pretrained large-scale image diffusion models for motion estimation in single-image rectification tasks such as Stitched Image Rectangling (SIR) and Rolling Shutter Correction (RSC).

By Ziyi Wang, Haipeng Li, Lin Sui, Tianhao Zhou, Hai Jiang, Lang Nie, Bing Zeng, Shuaicheng Liu
arXiv Machine Learning
Oct 3

Trajectory Stitching for Solving Inverse Problems with Flow-Based Models

The paper introduces MS-Flow, a method that represents a flow-based generative model’s trajectory as a sequence of intermediate latent states instead of a single initial code. By enforcing local flow dynamics and coupling trajectory segments with matching penalties, the approach alternates between updating latent states and ensuring consistency with observed data. This strategy reduces memory usage and improves reconstruction quality on tasks such as image inpainting, super‑resolution, and computed tomography.

By Alexander Denker, Zeljko Kereta, Carola-Bibiane Sch\"onlieb, Moshe Eliasof
arXiv AI
Sep 4

A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors

The paper introduces a Posterior‑Dynamics Framework that leverages pretrained diffusion models as multiscale priors for linear imaging inverse problems such as deblurring, super‑resolution, and inpainting. By constructing a surrogate likelihood centered on the clean image and incorporating diffusion uncertainty, the authors derive continuous posterior dynamics and a tunable Langevin component for adaptive exploration. They prove theoretical guarantees (endpoint consistency, finite‑horizon tracking, weak accuracy) and present the PD‑IMEX sampler, which achieves high‑quality reconstructions with only 100 score evaluations and controllable fidelity‑diversity trade‑offs.

By Zhaoqiang Liu, Tongyao Pang, Ruibing Wang, Yang Zheng
arXiv Computer Vision
Sep 3

Local Epistemic Uncertainty Guided Active Sampling for Plug-and-play Diffusive Image Restoration

The paper introduces LEADer, a framework that uses local epistemic uncertainty to guide active sampling in diffusion-based image restoration. By adjusting prior strength per pixel and pruning sampling trajectories based on uncertainty traces, LEADer balances detail preservation with artifact suppression and accelerates convergence. The method is plug‑and‑play, theoretically guarantees data consistency and stable convergence, and improves performance across multiple state‑of‑the‑art diffusion models with minimal memory overhead.

By Jiaqi Zhang, Zheng Pang, Rongrong Gao, Qiyuan Zhang, Yang Yang
arXiv Computer Vision
Aug 25

Pixel-Space Diffusion via Observation Operators

Pixel‑Space Diffusion via Observation Operators introduces a new framework for pixel‑space diffusion models that addresses a scale‑time mismatch in existing methods. By replacing fixed full‑image supervision with a time‑indexed observation trajectory that progresses from coarse structures to the full image, the model aligns supervision with the natural recovery order of image details. The approach employs Gaussian‑Lanczos operators and a GL‑CoDA decoder to refine features progressively, resulting in faster convergence and higher generation quality, achieving an FID of 1.52 on ImageNet‑256.

By Shaojie Guo, Lichen Ma, Haoyang Tong, Yu He, Zipeng Guo, Xiaoan Liu, Feng Yan, Yu Guo, Fei Wang, Junshi Huang, Yan Wang
arXiv Machine Learning
3d ago

ManiFusion: Unlocking the High-Throughput Generation via Superposition in Manifold Space

ManiFusion is a backbone‑agnostic framework that boosts the throughput of diffusion models by fusing multiple samples into a single denoising evaluation and then unfusing them afterward. It introduces Trajectory‑Fusion Scheduling to dynamically adjust fusion factors across sampling stages, allowing shared representations while preserving individual generation paths. The method works with various diffusion families, including U‑Net and transformer backbones in pixel and latent spaces, and can be combined with existing acceleration techniques to achieve higher throughput with minimal quality loss.

By Minkyu Kim, Baekseung Kim, Junhoo Lee, Jangho Kim, Nojun Kwak