arXiv Computer Vision

TaskIR: Task-Driven Image Restoration via Degradation Adaptation and Task Feedback

arXiv Computer Vision
Sep 21

SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration

SkillIR is a skill-guided framework for agentic image restoration that represents restoration experience as degradation-centered action evidence rather than full tool-use trajectories. It consolidates context-dependent action outcomes into scene-aware restoration skills, guiding one bounded action at a time within a verified residual-state loop. Experiments on synthetic and real-world multi-degradation datasets show that SkillIR improves restoration quality and enables more reliable and effective tool use.

By Jie Shao, Shengkai Hu, Xu Zhang, Beihang Song, Yongcheng Jing, Xu Wu, Jun Wan
arXiv Computer Vision
Aug 28

Loop-Mamba: A Loop Mamba with Degradation-Aware and Shared Memory for Old Photo Restoration

Loop‑Mamba is a lightweight, loop‑based state‑space framework designed for restoring old photographs that suffer from multiple degradations such as scratches, cracks, fading, blur, noise, and missing regions. It models restoration as progressive state evolution, using a Semantic‑Guided Degradation Estimator to predict local degradation maps and global scores, and a Shared Structural Memory Mamba to maintain a persistent restoration state across iterations. The method employs first‑order state recursion and a multi‑directional scanning strategy to reduce gradient dilution and computational overhead, and introduces the Old Photo Damage Recovery Score (ODRS) to evaluate both degradation recovery and structural reconstruction, achieving superior performance on the SynOld benchmark.

By Runci Bai, Yucheng Xin, Pu Wang, Yongcong Wang, Chen Wu, Dianjie Lu, Guijuan Zhang, Pengwen Dai, Guangwei Gao, Siyuan Yao, Zhuoran Zheng
arXiv Computer Vision
Sep 23

ImIR: Image-Instruction Tuning for All-in-One Image Restoration

The paper introduces ImIR, a method that tunes a large pretrained image‑editing model for all‑in‑one image restoration by replacing text prompts with continuous image‑derived instructions. The approach uses a lightweight token mapper to shift the degraded image’s vision‑language embedding toward that of a clean image, enabling a single adapter to handle six restoration tasks in about three hours on one GPU. ImIR outperforms text conditioning in matched comparisons and supports task‑agnostic restoration without requiring a degradation label.

By S\"uleyman Aslan, G\"orkay Aydemir, M{\i}sra Yavuz, Yunus Bilge Kurt, Nasrin Rahimi, Ahmet Rasim Emirda\u{g}{\i}, Burak Can Biner, M. Ak{\i}n Y{\i}lmaz
Hugging Face Trending Papers
Jul 30

CoRE-UIR: Prior-guided common and residual experts for efficient all-in-one remote sensing image restoration

Remote sensing images acquired by unmanned aerial vehicles (UAVs) and satellites are often degraded by adverse weather, illumination variation, and imaging artifacts, which may co-occur and jointly induce global distribution shifts and local structural corruption. Although All-in-One image restoration offers an appealing unified alternative to task-specific pipelines, existing methods still suffer from weak or implicit degradation cues and parameter redundancy caused by full-rank multi-expert designs with overlapping restoration behaviors.

arXiv Computer Vision
Sep 11

UniH$^3$: Unifying Hierarchical Homogeneity and Heterogeneity for All-in-One Medical Image Restoration

UniH$^3$ is a new framework for all-in-one medical image restoration that unifies hierarchical homogeneity and heterogeneity. It introduces a Hierarchical Homogeneity Memory (H2M) module to distill and retrieve shared anatomical priors, and a Hierarchical Heterogeneity Balancer (H2B) to mitigate inter- and intra-task conflicts during training. Experiments on MedIR-2D-500K and MedIR-3D-3K show that UniH$^3$ achieves state‑of‑the‑art performance for both multi‑task and single‑task restoration.

By Zhiwen Yang, Jiayin Li, Chengyu Liu, Hui Zhang, Bingzheng Wei, Yan Xu
arXiv Computer Vision
Sep 15

Restore What Matters: Lessons from Joint Restoration and Recognition

arXiv:2609.13791v1 Announce Type: new Abstract: Recognition pipelines typically adopt a restore-then-recognize workflow, yet decades of experience show that generating visually pleasing images seldom...

By Lanqing Guo, Xijun Wang, Minchul Kim, Yu Yuan, Wes Robbins, Xingguang Zhang, Nicholas Chimitt, Stanley H. Chan, Zhangyang Wang, Xiaoming Liu
arXiv Computer Vision
Aug 25

HP-UniIF: Hierarchical Prompt Learning for Unified Image Fusion

HP-UniIF is a unified vision framework that uses diffusion priors and a depth‑wise hierarchical conditional modulation strategy to support heterogeneous image fusion, visual restoration, and downstream perception tasks. The framework introduces task prompt modulation at bottleneck layers, a degradation prompt router at shallow layers, and an application prompt bank at decoding stages to decouple and adapt to different objectives. Experiments across multiple fusion tasks, degradations, and downstream applications show that HP‑UniIF achieves superior performance while maintaining visually faithful results and task‑relevant semantics.

By Xingxin Xu, Siqi Zhao, Xin Li, Xinjie Yao, Yiming Sun, Pengfei Zhu