arXiv Machine Learning

TEX-MEX: Similarity-Guided Temporal Contrastive Learning for Time Series

arXiv Machine Learning
Jul 2

LeNEPA: No-Augmentation Next-Latent Prediction for Time-Series Representation Learning

arXiv:2607. 00958v1 Announce Type: new Abstract: Time series are central to modern data mining applications, from industrial telemetry and server metrics to finance and physiology, yet time-series self-supervised learning often depends on view and augmentation choices that encode domain-specific invariances.

By Alexander Chemeris, Ming Jin, Randall Balestriero
arXiv Machine Learning
Sep 29

Progressive Memory Transformer: Memory-Aware Attention for Time-Series

The paper introduces the Progressive Memory Transformer (PMT), a transformer variant that adds writable, window‑aligned memory to expose mid‑range representations alongside token and sequence‑level outputs. PMT is trained with a hierarchical learning framework that applies separate objectives at local, mid‑range, and global scales, encouraging the model to capture fine‑grained variation, window‑level motifs, and overall sequence agreement. Experiments on seven UCR/UEA/UCI classification datasets, a cue‑retention probe, and forecasting tasks show that PMT achieves strong low‑label classification performance, competitive multi‑horizon forecasting, and evidence that its memory states encode mid‑range motifs.

By Tord Sture Stangeland, Andreas K\"ohler, Steffen M{\ae}land, Ad\'in Ram\'ires Rivera
arXiv Machine Learning
Oct 16

Local Temporal Contrasts on Human Motion Data Induce a Latent Geometry

The paper introduces SemTAC, an encoder trained with a temporal-neighborhood contrastive loss to preserve local consistency in human motion time series, enabling inference at temporal scales beyond training. SemTAC outperforms four baselines on a five-step motion sequence discrimination task, especially on truncated sequences where it achieves a median F1 of 0.77 versus 0.27–0.70 for others. Its representations form interpretable geometric trajectories, surpassing a no-structure baseline on a displacement‑smoothness metric.

By Louren\c{c}o A. Rodrigues, Felix Putze
arXiv Machine Learning
Aug 6

Prototype-based Self-Supervised Multimodal Learning for PPG and Accelerometry Signals

arXiv:2510. 09764v2 Announce Type: replace Abstract: Modeling multi-modal time-series data is critical for capturing system-level dynamics, particularly in biosignals where modalities such as ECG, PPG, EDA, and accelerometry provide complementary perspectives on interconnected physiological processes.

By Wanting Mao, Maxwell A Xu, Harish Haresamudram, Mithun Saha, Santosh Kumar, James Matthew Rehg
arXiv Machine Learning
Sep 7

Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signal

Brain4FMs is a unified benchmark for evaluating brain foundation models (BFMs) on both scalp EEG and intracranial EEG (iEEG). It incorporates 17 representative models and 21 public datasets spanning clinical diagnosis, sleep staging, communication, and affective computing, and offers dataset-aware preprocessing, cross‑subject evaluation, and standardized downstream workflows. The benchmark highlights that no single BFM consistently outperforms others across all tasks, modalities, and adaptation protocols, prompting further exploratory analyses of model‑specific spatial, spectral, and discrete representations.

By Fanqi Shen, Enhong Yang, Jiahe Li, Junru Hong, Xiaoran Pan, Zhizhang Yuan, Meng Li, Yang Yang