arXiv Machine Learning
Aug 17

The Expressive Limits of Diagonal SSMs for State-Tracking

arXiv:2603. 01959v2 Announce Type: replace Abstract: State-Space Models (SSMs) have recently been shown to achieve strong empirical performance on a variety of long-range sequence modeling tasks while remaining efficient and highly-parallelizable.

By Mehran Shakerinava, Behnoush Khavari, Siamak Ravanbakhsh, Sarath Chandar
arXiv Machine Learning
Aug 14

A Simple State Space Model Excels at Multivariate Time Series Classification

arXiv:2605. 27406v2 Announce Type: replace Abstract: Structured state space models (SSMs) have recently emerged as a promising foundation for sequence modeling, with Mamba-based architectures demonstrating strong performance through input-dependent state transitions, albeit at considerable complexity.

By Hassan Saadatmand, Geoffrey I. Webb, Hamid Rezatofighi, Mahsa Salehi
arXiv Machine Learning
Sep 10

Online Signature Verification Using Augmented Path Signature and T-Mamba

The paper introduces a new online signature verification framework that combines the augmented path signature (APS) descriptor with a T-Mamba model. APS applies time and basepoint augmentations followed by sliding-window path signatures, capturing geometric structures and nonlinear inter-channel interactions. T-Mamba, a hybrid of two temporal convolutional network blocks and a time-scanning Mamba, learns both local temporal patterns and global long-range dependencies, achieving state‑of‑the‑art equal error rates on three public benchmark datasets.

By Ruiling Li, Danyu Yang
arXiv AI
2d ago

Reshape and Recur: Improving SSMs with Input Reshaping and Depth Recurrence

The paper proposes two extensions to State Space Models (SSMs) to reduce memory usage and improve performance. First, it introduces depth recurrence, allowing a looped SSM with fewer parameters to match the performance of a larger, non-recurrent model. Second, it advocates using a fixed time granularity across tasks by reshaping input sequences, which enhances how information is presented to the model. Both techniques consistently benefit four representative SSM architectures (LRU, S5, LinOSS, LrcSSM).

By M\'onika Farsang, Ramin Hasani, Daniela Rus, Radu Grosu