arXiv Machine Learning June 25, 2026 By Klaus Schertler, Xiomara Runge, Andrea Ceni, David Kappel, Claudio Gallicchio

Frequency Domain Reservoir Computing

Read the original on arXiv Machine Learning →

arXiv:2606. 24969v1 Announce Type: new Abstract: While the quadratic sequence-length bottleneck of transformers has fueled a resurgence in recurrent models, effectively capturing complex dynamics requires architectures that balance efficient training with highly expressive latent states.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 6

Echo Flow Networks

arXiv:2509. 24122v3 Announce Type: replace Abstract: At the heart of time-series forecasting (TSF) lies a fundamental challenge: how can models efficiently and effectively capture long-range temporal dependencies across ever-growing sequences?

By Hongbo Liu, Jia Xu

benchmarks

arXiv AI

Aug 11

Deep Residual Echo State Networks: exploring residual orthogonal connections in untrained Recurrent Neural Networks

arXiv:2508. 21172v3 Announce Type: replace-cross Abstract: Echo State Networks (ESNs) are a particular type of untrained Recurrent Neural Networks (RNNs) within the Reservoir Computing (RC) framework, popular for their fast and efficient learning.

By Matteo Pinna, Andrea Ceni, Claudio Gallicchio

arXiv Machine Learning

1d ago

RecurrentGPT: Expressive Depth through Recurrent Modulation in Transformers

arXiv:2608. 15062v1 Announce Type: cross Abstract: Scaling transformer language models creates an inherent tension between expressivity and memory efficiency.

By Amr Hegazy, Amr Alanwar, Mostafa Elhoushi

llms efficiency

arXiv AI

Jul 9

Exploration of Fast-Slow Latent Recurrence for Train-Short, Test-Long Generalization

arXiv:2604. 01577v3 Announce Type: replace-cross Abstract: We study out of distribution generalization in streaming tasks where models are trained on short sequences but must operate over much longer, unknown horizons under bounded memory.

By Shota Takashiro, Masanori Koyama, Takeru Miyato, Yusuke Iwasawa, Yutaka Matsuo, Kohei Hayashi

llms reinforcement-learning safety

arXiv AI

Jun 4

MesaNet: Sequence Modeling by Locally Optimal Test-Time Training

arXiv:2506. 05233v2 Announce Type: replace-cross Abstract: Sequence modeling is currently dominated by causal transformer architectures that use softmax self-attention.

By Johannes von Oswald, Nino Scherrer, Seijin Kobayashi, Luca Versari, Songlin Yang, Sarthak Mittal, Maximilian Schlegel, Kaitlin Maile, Yanick Schimpf, Oliver Sieberling, Alexander Meulemans, Rif A. Saurous, Guillaume Lajoie, Charlotte Frenkel, Razvan Pascanu, Blaise Ag\"uera y Arcas, Jo\~ao Sacramento

llms benchmarks

arXiv Machine Learning

Jul 2

StateFlow: Dual-State Recurrent Modeling for Long-Horizon Time Series Forecasting

arXiv:2607. 00197v1 Announce Type: new Abstract: Long-horizon multivariate time series forecasting (LTSF) remains challenging due to non-stationarity, regime shifts, and error accumulation.

By Haroon Gharwi, Yue Dai, Kai Shu

llms benchmarks

Related stories

Echo Flow Networks

Deep Residual Echo State Networks: exploring residual orthogonal connections in untrained Recurrent Neural Networks

RecurrentGPT: Expressive Depth through Recurrent Modulation in Transformers

Exploration of Fast-Slow Latent Recurrence for Train-Short, Test-Long Generalization

MesaNet: Sequence Modeling by Locally Optimal Test-Time Training

StateFlow: Dual-State Recurrent Modeling for Long-Horizon Time Series Forecasting