arXiv AI By Chunxiao Liu, Wei Liu, Anbin Xiong, Erli Meng

Beyond Uniform Restoration: Empowering All-in-One Restoration with Pixel-Level Multimodal Guidance

Read the original on arXiv AI →

arXiv:2608. 09482v1 Announce Type: cross Abstract: All-in-one image restoration is a unified low-level vision task that aims to effectively recover high-quality images from inputs degraded by various types and levels of corruption using a single model.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Sep 23

ImIR: Image-Instruction Tuning for All-in-One Image Restoration

The paper introduces ImIR, a method that tunes a large pretrained image‑editing model for all‑in‑one image restoration by replacing text prompts with continuous image‑derived instructions. The approach uses a lightweight token mapper to shift the degraded image’s vision‑language embedding toward that of a clean image, enabling a single adapter to handle six restoration tasks in about three hours on one GPU. ImIR outperforms text conditioning in matched comparisons and supports task‑agnostic restoration without requiring a degradation label.

By S\"uleyman Aslan, G\"orkay Aydemir, M{\i}sra Yavuz, Yunus Bilge Kurt, Nasrin Rahimi, Ahmet Rasim Emirda\u{g}{\i}, Burak Can Biner, M. Ak{\i}n Y{\i}lmaz
arXiv Computer Vision
Sep 21

SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration

SkillIR is a skill-guided framework for agentic image restoration that represents restoration experience as degradation-centered action evidence rather than full tool-use trajectories. It consolidates context-dependent action outcomes into scene-aware restoration skills, guiding one bounded action at a time within a verified residual-state loop. Experiments on synthetic and real-world multi-degradation datasets show that SkillIR improves restoration quality and enables more reliable and effective tool use.

By Jie Shao, Shengkai Hu, Xu Zhang, Beihang Song, Yongcheng Jing, Xu Wu, Jun Wan
Hugging Face Trending Papers
Jun 30

MG-SpaIR: Multi-grade Sparse-guided Implicit Representation for Training-Data-Free Image Restoration

MG-SpaIR is a training-data-free framework for restoring a clean image from a single observation corrupted by a mixture of blur, downsampling, noise, and missing pixels. Building on implicit neural representations (INRs), we introduce a multi-grade coarse-to-fine residual hierarchy that progressively refines the reconstruction across resolution grades, improving representational fidelity and mitigating spectral limitations.