arXiv:2509. 24122v3 Announce Type: replace Abstract: At the heart of time-series forecasting (TSF) lies a fundamental challenge: how can models efficiently and effectively capture long-range temporal dependencies across ever-growing sequences?
By Hongbo Liu, Jia Xu
arXiv:2606. 24969v1 Announce Type: new Abstract: While the quadratic sequence-length bottleneck of transformers has fueled a resurgence in recurrent models, effectively capturing complex dynamics requires architectures that balance efficient training with highly expressive latent states.
By Klaus Schertler, Xiomara Runge, Andrea Ceni, David Kappel, Claudio Gallicchio
The paper investigates how training shapes the geometry of recurrent network dynamics in Reservoir Computing (RC) networks used for temporal forecasting. It demonstrates that, in a linear continuous-time reservoir with infinite data, training data create an invariant subspace whose dimension matches the number of dominant modes. For a simplified diagonal linear reservoir, the study connects dominant eigenvalues and eigenvectors to the spectrum of a backward Dynamic Mode Decomposition matrix, providing a finite-dimensional approximation of the backward-time Koopman operator, and illustrates these phenomena through simulation while suggesting extensions to nonlinear RC.
By Noa Kaplan, Alberto Padoan, Anastasia Bizyaeva
arXiv:2508. 21172v3 Announce Type: replace-cross Abstract: Echo State Networks (ESNs) are a particular type of untrained Recurrent Neural Networks (RNNs) within the Reservoir Computing (RC) framework, popular for their fast and efficient learning.
By Matteo Pinna, Andrea Ceni, Claudio Gallicchio
The paper introduces ELiSe, a model that leverages cortical network scaffolds and dendritic compartments to learn complex non‑Markovian spatio‑temporal patterns using only local, always‑on, phase‑free synaptic plasticity. It demonstrates the model’s ability to acquire and replay intricate sequences, exemplified by a birdsong learning mock‑up, and shows robustness to external disturbances and flexibility in parameter settings.
By Laura Kriener, Kristin V\"olk, Ben von H\"unerbein, Federico Benitez, Walter Senn, Mihai A. Petrovici
arXiv:2607. 24420v1 Announce Type: cross Abstract: Reservoir computing has emerged as an efficient machine learning framework for predicting time series generated by dynamical systems.
By Arthur S Powanwe