arXiv Machine Learning
Aug 27

WAVE: Reversing the Guidance Hierarchy for Coarse-to-Fine Guided Depth Super-Resolution

WAVE introduces a multi-level discrete wavelet transform (ML‑DWT) to reverse the typical fine‑to‑coarse bias in guided depth super‑resolution. By consuming wavelet sub‑bands and semantic tokens in reverse order, it separates structure and detail reconstruction, applies semantic gating to high‑frequency bands, and fuses modalities via an invertible coupling mechanism. Experiments on multiple benchmarks show that WAVE matches or outperforms existing methods, especially at high upsampling factors where low‑resolution depth has minimal structure.

By Tayyab Nasir, Daochang Liu, Ajmal Mian
arXiv Machine Learning
Aug 26

NAIMA: Semantics Aware RGB Guided Depth Super-Resolution

The paper introduces NAIMA, a guided depth super‑resolution framework that leverages global contextual semantic priors from pretrained vision transformer token embeddings. Its Guided Token Attention (GTA) module uses depth encodings as queries to attend over semantic tokens, with a zero‑initialized gate controlling the influence of semantic evidence. NAIMA achieves competitive in‑distribution performance while delivering superior cross‑dataset generalization without relying on decoded priors or auxiliary objectives.

By Tayyab Nasir, Daochang Liu, Ajmal Mian
arXiv AI
6d ago

Wavelet Phase Diffusion for Structurally and Semantically Consistent Sim-to-Real Translation

Wavelet Phase Diffusion (ψ‑PD) is a new simulation‑to‑real translation method that operates in the Dual‑Tree Complex Wavelet Packet Transform domain, allowing spatially adaptive phase injection without global spectral interference. It also introduces Low‑Frequency Randomization to decouple the model from synthetic illumination priors, enabling realistic, in‑distribution real‑world appearance while preserving structural and semantic consistency. Trained on unpaired open‑domain data, ψ‑PD achieves superior realism and semantic consistency on vKITTI→KITTI image translation and improves CARLA video translation performance, reducing planner errors by over 5%.

By Kaiwen Wang, Frank Bieder, Yinzhe Shen, Carlos Fernandez, Jan-Hendrik Pauls, Omer Sahin Tas