arXiv AI

X-RACE: XAI-assisted Recurrent neural network Attribution for Channel Estimation

The paper introduces X-RACE, a framework that combines explainable AI with recurrent neural networks to improve channel estimation in high‑mobility vehicular environments. X-RACE employs a low‑complexity, one‑shot dual‑optimization strategy to prune unnecessary input subcarriers and hidden units, while also defining new temporal XAI metrics—Saturation Time, Importance Drift, and Relevance Contrast—to analyze LSTM learning dynamics. Simulation results show that X-RACE cuts inference complexity by at least 44.1% and maintains or improves Bit Error Rate performance compared to traditional XAI methods.

arXiv Machine Learning
Sep 17

FedPGT: Progressive Gradient Transmission for Vehicular Federated Learning over Time-Varying Channels

FedPGT introduces a progressive gradient transmission scheme for vehicular federated learning over time‑varying channels, where vehicles send high‑magnitude gradient entries according to instantaneous channel conditions. The authors derive a convergence bound showing diminishing returns governed by a power‑law decay, and formulate a stochastic optimization problem that is solved via a Lyapunov drift‑plus‑penalty approach with per‑slot surrogate variables. A low‑complexity resource allocation algorithm is proposed, and experiments on CIFAR‑10 and Argoverse demonstrate a 3.65% accuracy gain and a 12.66% reduction in displacement error compared to state‑of‑the‑art baselines.

By Jintao Yan, Tan Chen, Yuxuan Sun, Sheng Zhou, Zhisheng Niu
arXiv Machine Learning
Jun 25

Frequency Domain Reservoir Computing

arXiv:2606. 24969v1 Announce Type: new Abstract: While the quadratic sequence-length bottleneck of transformers has fueled a resurgence in recurrent models, effectively capturing complex dynamics requires architectures that balance efficient training with highly expressive latent states.

By Klaus Schertler, Xiomara Runge, Andrea Ceni, David Kappel, Claudio Gallicchio
arXiv AI
Aug 25

DRIFT: Joint Channel Estimation and Prediction Towards Pilotless 6G Non-Terrestrial Networks

The paper introduces DRIFT, a lightweight framework for joint channel estimation and prediction in low Earth orbit non-terrestrial networks, aiming to reduce pilot overhead by using data-driven processing after the initial slot. DRIFT refines data-aided channel estimates and forecasts future channel responses with low computational cost, offering two variants based on convolutional and LSTM layers. Simulations show up to 12% spectral efficiency gain over conventional pilot-based systems, with under 200k multiply-accumulate operations suitable for on-board satellite implementation.

By Bruno De Filippo, Carla Amatetti, Alessandro Vanelli-Coralli
arXiv AI
Aug 28

MambaCSP: Hybrid-Attention State Space Models for Hardware-Efficient Channel State Prediction

MambaCSP is a hybrid-attention state space model that replaces transformer-based backbones with a linear-time Mamba architecture for channel state prediction. By adding lightweight patch‑mixer attention layers, it captures long‑range dependencies while maintaining hardware efficiency. Experiments on MISO‑OFDM show 9‑12% higher accuracy, 3× faster throughput, 2.6× lower VRAM usage, and 2.9× faster inference compared to LLM‑based methods.

By Aladin Djuhera, Haris Gacanin, Holger Boche
arXiv Machine Learning
Sep 25

Learnable Time-Frequency Masks for Explaining Time-Series Classifiers

The paper introduces XACT, a framework that learns sparse attribution masks over coefficients from any invertible time‑frequency transform, such as STFT, continuous wavelet transform, and discrete wavelet transform. XACT extends the virtual inspection layer approach to wavelet transforms, enabling Layer‑wise Relevance Propagation (LRP) to generate explanations in these representations. Experiments on synthetic and two real‑world datasets show that XACT produces precise, sparse, and structured explanations, often outperforming baseline methods in highlighting relevant features.

By Theresa Dahl Frehr, Francisco Pelayo, Lukas Raad, Alicia Garc\'ia Sanz, Thea Br\"usch, Tommy Sonne Alstr{\o}m
arXiv Machine Learning
Aug 27

Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation

The paper introduces Gated Recurrent Transformers, a depth‑sharing architecture that brackets a single shared core with fixed prelude and coda blocks and uses a lightweight projection and element‑wise update gate to modulate recurrent updates. This design allows functional specialization across recurrences while reducing memory footprint. Experiments show that, under equal FLOPs or parameter budgets, the recurrent model matches or surpasses deeper GPT‑2 Small baselines, achieving similar or better accuracy with fewer parameters and lower peak decoding memory.

By Amr Hegazy, Amr Alanwar, Mostafa Elhoushi