arXiv AI

Turning TS2Vec into a Foundation Model for Time Series Classification

arXiv Machine Learning
4d ago

Backpropagation-free Deep Learning for Time-Series Classification

The paper evaluates three backpropagation‑free learning rules—Direct Feedback Alignment, Direct Random Target Projection, and NoProp—on 112 univariate time‑series classification datasets using 1D convolutional networks. Each method achieves mean F1 scores between 0.76 and 0.79, slightly below state‑of‑the‑art backpropagation baselines. The study also analyzes how dataset properties, especially intra‑class temporal variability, affect performance gaps and examines computational trade‑offs such as FLOPs, training speed, and memory usage.

By Miha Kap\v{s}, Bla\v{z} Bertalani\v{c}, Carolina Fortuna
arXiv Machine Learning
Jul 2

LeNEPA: No-Augmentation Next-Latent Prediction for Time-Series Representation Learning

arXiv:2607. 00958v1 Announce Type: new Abstract: Time series are central to modern data mining applications, from industrial telemetry and server metrics to finance and physiology, yet time-series self-supervised learning often depends on view and augmentation choices that encode domain-specific invariances.

By Alexander Chemeris, Ming Jin, Randall Balestriero
arXiv Machine Learning
Oct 19

RTSM: Adapting Recursive Models to Multivariate Time-Series Classification

The paper introduces the Recursive Time-Series Model (RTSM), a deep-learning architecture that uses a learned convolutional temporal tokenizer, a single-state weight‑tied refinement module, and a pooled classification readout to classify multivariate time‑series data. On the 30 UEA datasets, RTSM achieves a mean accuracy of 72.81% under validation‑based configuration, surpassing all 17 evaluated deep‑learning models and outperforming MambaSL by 1.60 percentage points. Ablation studies show that the proposed tokenizer and single‑state design outperform simpler convolutional embeddings and two‑state variants, and the full classifier reaches 86.10% mean accuracy compared to 84.79% for a tokenizer‑only classifier.

By Georg Tenzing, Anna Tegon, Luca Benini, Thorir Mar Ingolfsson
arXiv Computer Vision
Sep 30

TT-VidT: Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining

TT-VidT is a video pretraining method that decouples the temporal axis by combining a per‑frame ViT-B/16 spatial encoder with a compact Temporal Transfer Layer trained via Diff Compression. The authors conduct a systematic 24‑configuration study to isolate architecture, objective, and decoder effects, showing that the full TT-VidT design yields the strongest motion‑sensitive representations. In downstream fine‑tuning, TT‑VidT outperforms state‑of‑the‑art baselines on Jester, Something‑Something V2, ARID, and Diving48 while using significantly fewer encoder FLOPs.

By Shih-Ying Yeh, Daniel Z. Kaplan, Xuehai Wang, Fu-En Yang, Min-Hung Chen, Shang-Hong Lai