arXiv Computer Vision

FreeTransformSR: Efficient Lightweight Image Super-Resolution via Free Low-Rank Learnable Transform

FreeTransformSR is a lightweight image super‑resolution network that uses a channel‑wise free low‑rank learnable transform to adaptively modulate features with minimal parameters. It adds a local feature modulation branch with depthwise convolution and a soft complexity adaptive module that fuses local convolution and window self‑attention based on texture characteristics. The model also employs an adaptive intensity modulation strategy and achieves competitive PSNR/SSIM on five benchmark datasets while using only 595K parameters and running faster than competing methods.

arXiv Computer Vision
Sep 4

SPARK: Input-Conditioned Sparse Activation Modulation for Frozen DiT-based Super-Resolution

The paper introduces SPARK, a lightweight input‑conditioned controller that modulates only a few dominant channels in frozen Diffusion Transformer (DiT) based super‑resolution models. By predicting bounded per‑channel affine transformations for selected channels, SPARK improves reconstruction fidelity and perceptual quality without fine‑tuning the backbone or adding adapters. Experiments on three DiT‑based SR backbones across DIV2K, RealSR, and DRealSR demonstrate consistent gains while modulating only eight channels per stream and block.

By Federico Putamorsi, Leonardo Zini, Marcella Cornia, Lorenzo Baraldi
Hugging Face Trending Papers
Jun 17

GB-LSR: A Fast Local Spectral Image Representation with a Single Global Bandwidth for Continuous Reconstruction and Super-Resolution

We present GB-LSR (Global-Bandwidth Local Spectral Representation), a fixed-grid local spectral representation for continuous image reconstruction. The image domain is partitioned into non-overlapping square patches, each carrying coefficients for a truncated Fourier basis predicted from shared convolutional-encoder features.

arXiv Computer Vision
Sep 4

ProgResViT: Progressive Resolution and Width for Adaptive Vision Transformers

ProgResViT is an input‑adaptive Vision Transformer that processes images progressively across multiple rounds, starting with a low‑resolution image and a narrow subnetwork and refining the prediction with higher resolution and a wider subnetwork if needed. The method introduces Progress‑Conditioned Soft Gating (PSG) to share a single backbone across rounds while conditioning token fusion and layer outputs on the current round, block, and input resolution. Experiments on DeiT show improved accuracy‑compute trade‑offs compared to adaptive‑width, adaptive‑depth, and dynamic‑token baselines, and the design also benefits self‑supervised DINO representations and downstream semantic segmentation.

By Ali Hojjat, Janek Haberer, Olaf Landsiedel