arXiv Machine Learning

TransECG-SSL: Hybrid Self-Supervised Representation Learning for ECG Arrhythmia Classification

TransECG-SSL is a self‑supervised framework that learns transferable heartbeat representations from unlabelled ECG data using a Transformer encoder pretrained with a hybrid objective of masked signal reconstruction and contrastive learning. The pretrained model is frozen and evaluated via linear probing on patient‑disjoint splits across three public ECG databases, showing that Hybrid SSL outperforms randomly initialized Transformers and source‑supervised pretraining. While cross‑dataset transfer improves performance over random baselines, it still falls short of target‑specific self‑supervised pretraining, and minority arrhythmia classes remain difficult under severe class imbalance.

arXiv AI
Jun 19

SL-S4Wave: Self-Supervised Learning of Physiological Waveforms with Structured State Space Models

arXiv:2606. 19888v1 Announce Type: cross Abstract: Modeling long-sequence medical time series data, such as electrocardiograms (ECG), poses significant challenges due to high sampling rates, multichannel signal complexity, inherent noise, and limited labeled data.

By Feng Wu, Harsh Deep, Eric Lehman, Sanyam Kapoor, Guoshuai Zhao, Rahul Krishnan, Gari Clifford, Li-wei H Lehman
arXiv Computer Vision
Sep 25

A Hybrid CNN--State-Space--Attention Backbone with Joint-Embedding Predictive Pretraining for 12-Lead ECG Classification

The paper presents a hybrid CNN–state‑space–attention backbone designed for 12‑lead ECG classification, combining early waveform tokenization, mixed temporal dynamics modeling, and late global attention. It introduces an ECG‑oriented Joint‑Embedding Predictive Pretraining (JEPA) that samples span masks at latent resolution and predicts clean latent targets via a momentum encoder, avoiding waveform reconstruction. Experiments on CPSC2018, Chapman‑Shaoxing, and PTB‑XL, with pretraining on ~350K unlabeled CODE‑15 recordings, demonstrate strong supervised baselines and improved transfer, especially in low‑label scenarios and with LoRA adaptation.

By Yakoub Bazi, Sarah Aljuhani, Mohamad M. Al Rahhal, Mansour Zuair, Naif Alajlan