arXiv Computer Vision

Semantic-Guided Frequency Modulation for Learned Image Compression

arXiv AI
1d ago

Neural Image Compression with Internal-External Prior Fusion and Alignment

The paper introduces Neural Image Compression with Internal-External Prior Fusion and Alignment (IE-PFA), a context model that combines internal priors from the current image with an external dictionary shared by encoder and decoder. It employs a RWKV-based Spatial-Channel Prior Fusion (RSCPF) module for efficient fusion and a Self-Distilled Prior Alignment (SDPA) mechanism for alignment during training. The model supports variable-rate coding across 64 quality levels, achieves a 21.65% BD-Rate saving over VTM-22.0-Intra, uses only 29.9M parameters, and offers fast encoding (61 ms) and decoding (52 ms) speeds.

By Tiancheng Si, Wenlong Xu, Dahua Gao
arXiv Machine Learning
Aug 27

WAVE: Reversing the Guidance Hierarchy for Coarse-to-Fine Guided Depth Super-Resolution

WAVE introduces a multi-level discrete wavelet transform (ML‑DWT) to reverse the typical fine‑to‑coarse bias in guided depth super‑resolution. By consuming wavelet sub‑bands and semantic tokens in reverse order, it separates structure and detail reconstruction, applies semantic gating to high‑frequency bands, and fuses modalities via an invertible coupling mechanism. Experiments on multiple benchmarks show that WAVE matches or outperforms existing methods, especially at high upsampling factors where low‑resolution depth has minimal structure.

By Tayyab Nasir, Daochang Liu, Ajmal Mian
arXiv Computer Vision
Sep 15

MambaMPD: A Mamba-Driven Segmentation Framework for Marine Pollution Detection from Remote Sensing Imagery

MambaMPD is a new segmentation framework that leverages Vision Mamba models for marine pollution detection in remote‑sensing imagery. It introduces two structural priors—Frequency‑Aware Augmentation (FAA) and multi‑scale Edge‑Guided Attention (EGA)—to better capture low‑contrast, fragmented pollution patterns and sharpen boundaries. Experiments on the MADOS and M4D datasets show that MambaMPD outperforms existing methods in mIoU while using far less computation than foundation‑model approaches.

By Shuaiyu Chen, Wei Han, Peng Ren, Chunbo Luo, Zeyu Fu
arXiv Computer Vision
Sep 11

FreeTransformSR: Efficient Lightweight Image Super-Resolution via Free Low-Rank Learnable Transform

FreeTransformSR is a lightweight image super‑resolution network that uses a channel‑wise free low‑rank learnable transform to adaptively modulate features with minimal parameters. It adds a local feature modulation branch with depthwise convolution and a soft complexity adaptive module that fuses local convolution and window self‑attention based on texture characteristics. The model also employs an adaptive intensity modulation strategy and achieves competitive PSNR/SSIM on five benchmark datasets while using only 595K parameters and running faster than competing methods.

By Hongji Li, Yunhui Li
Hugging Face Trending Papers
Aug 4

FreqAdapt: Frequency-Adaptive Processing for RAW Object Detection

Existing object detection methods predominantly utilize sRGB inputs, which are compressed from RAW sensor data using Image Signal Processors (ISP) originally designed for visualization purposes. Compared to RGB images, RAW images possess favorable noise characteristics and richer information representation, which are crucial for object detection, particularly under challenging conditions such as adverse weather or low-light environments.

arXiv Computer Vision
Aug 28

High-Frequency First: A Two-Stage Approach for Improving Image INR

The paper proposes a two-stage training strategy for Implicit Neural Representations (INRs) that addresses spectral bias by using a neighbor-aware soft mask to emphasize high-frequency details early in training. In the first stage, the mask assigns higher weights to pixels with strong local variations, encouraging the network to focus on fine edges and textures. The second stage transitions to full-image training, and experiments show consistent improvements in reconstruction quality across existing INR methods.

By Sumit Kumar Dam, Mrityunjoy Gain, Eui-Nam Huh, Choong Seon Hong
arXiv Computer Vision
Sep 7

HyVIC: A Metric-Driven Spatio-Spectral Hyperspectral Image Compression Architecture Based on Variational Autoencoders

HyVIC is a configurable variational autoencoder designed for hyperspectral image compression that explicitly separates spatial and spectral feature learning. By allowing independent control of these two aspects, the architecture improves reconstruction fidelity across a wide range of compression ratios, achieving up to 4.66 dB better BD‑PSNR than previous methods. The authors also introduce a metric‑driven strategy for hyperparameter selection and provide code and pretrained models publicly.

By Martin Hermann Paul Fuchs, Behnood Rasti, Beg\"um Demir