arXiv Computer Vision

Look Before You Restore: Learning to Predict Before Acting for Agentic Image Restoration

arXiv Computer Vision
Sep 21

SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration

SkillIR is a skill-guided framework for agentic image restoration that represents restoration experience as degradation-centered action evidence rather than full tool-use trajectories. It consolidates context-dependent action outcomes into scene-aware restoration skills, guiding one bounded action at a time within a verified residual-state loop. Experiments on synthetic and real-world multi-degradation datasets show that SkillIR improves restoration quality and enables more reliable and effective tool use.

By Jie Shao, Shengkai Hu, Xu Zhang, Beihang Song, Yongcheng Jing, Xu Wu, Jun Wan
arXiv Computer Vision
Oct 9

DLC: A Metric-Guided Dynamic Loss Controller for Multi-Objective Training

The paper introduces DLC, a metric-guided dynamic loss controller that adjusts the weighting of existing training losses during multi-objective image restoration. DLC evaluates the model on a fixed feedback subset and uses quality metrics to update the loss-weight vector via an LLM-based controller, without altering the restoration architecture or adding new loss terms. Experiments on low-light enhancement, deraining, and super-resolution demonstrate that DLC guides training toward balanced fidelity and perceptual quality across diverse domains.

By Jaewan Ko, Janghoon Choi
arXiv Computer Vision
Sep 23

ImIR: Image-Instruction Tuning for All-in-One Image Restoration

The paper introduces ImIR, a method that tunes a large pretrained image‑editing model for all‑in‑one image restoration by replacing text prompts with continuous image‑derived instructions. The approach uses a lightweight token mapper to shift the degraded image’s vision‑language embedding toward that of a clean image, enabling a single adapter to handle six restoration tasks in about three hours on one GPU. ImIR outperforms text conditioning in matched comparisons and supports task‑agnostic restoration without requiring a degradation label.

By S\"uleyman Aslan, G\"orkay Aydemir, M{\i}sra Yavuz, Yunus Bilge Kurt, Nasrin Rahimi, Ahmet Rasim Emirda\u{g}{\i}, Burak Can Biner, M. Ak{\i}n Y{\i}lmaz
arXiv AI
4d ago

Look Back to Move Forward: Learning to Revisit for Agentic Compositional Image Generation

arXiv:2610.16224v1 Announce Type: cross Abstract: Text-to-image models have made remarkable progress in visual fidelity and instruction following, yet complex compositional generation remains challen...

By Zixu Wang, Xiaoran Zhao, Yahui Liu, Feng-ao Wang, Junhao Xiao, You Shu, Bing Liu, Yiting Liu, Songlei Jian, Zhiliang Tian, Dongsheng Li