arXiv Machine Learning

The Neural Echo: A Signal Processing Perspective for Understanding Neural Networks

arXiv:2608. 04864v1 Announce Type: cross Abstract: We introduce the neural echo as a tool for understanding the behavior of neural networks.

arXiv Computer Vision
Oct 22

How Do DiTs Denoise? An Aggregator-Predictor View of Attention and MLPs

The paper investigates how diffusion transformers (DiTs) denoise images by framing them as aggregator–predictor models that use context aggregation and patch prediction. It shows that for Gaussian Markov random field priors, a global Bayes denoiser can be approximated with a limited context, and that patchwise linear denoisers recover empirical local denoisers when aggregation is informative. Experiments confirm that DiTs trained on real images exhibit noise‑dependent denoising contexts and that replacing DiT MLPs with shared‑memory patch predictors yields competitive performance, while cross‑dataset component transplantation supports the proposed functional roles of attention and MLPs.

By Gyeonghun Kang, William Xingxu Chen, Xiang Cheng
arXiv Computer Vision
Sep 15

SAR-FAH: A Frequency-Adaptive Hybrid Network based on Neural ODEs for Structural-Preserving SAR Despeckling

SAR-FAH is a Frequency‑Adaptive Hybrid network that uses Neural Ordinary Differential Equations (NODEs) to despeckle Synthetic Aperture Radar (SAR) images. It separates homogeneous and heterogeneous regions in the frequency domain via wavelet transform, then applies a NODE‑based module to low‑frequency sub‑bands for smooth denoising and an enhanced U‑Net with deformable convolutions to high‑frequency sub‑bands for edge and texture preservation. Experiments on synthetic and real SAR data show that SAR‑FAH outperforms current state‑of‑the‑art despeckling methods both quantitatively and qualitatively.

By Ziqing Ma, Chang Yang, Zhichang Guo, Yao Li
arXiv Machine Learning
Aug 6

Echo Flow Networks

arXiv:2509. 24122v3 Announce Type: replace Abstract: At the heart of time-series forecasting (TSF) lies a fundamental challenge: how can models efficiently and effectively capture long-range temporal dependencies across ever-growing sequences?

By Hongbo Liu, Jia Xu