arXiv Machine Learning

Self-Supervised Dynamical System Representations for Physiological Time-Series

arXiv:2512. 00239v2 Announce Type: replace Abstract: The effectiveness of self-supervised learning (SSL) for physiological time series depends on the ability of a pretraining objective to preserve information about the underlying physiological state while filtering out unrelated noise.

arXiv Machine Learning

Aug 6

Prototype-based Self-Supervised Multimodal Learning for PPG and Accelerometry Signals

arXiv:2510. 09764v2 Announce Type: replace Abstract: Modeling multi-modal time-series data is critical for capturing system-level dynamics, particularly in biosignals where modalities such as ECG, PPG, EDA, and accelerometry provide complementary perspectives on interconnected physiological processes.

By Wanting Mao, Maxwell A Xu, Harish Haresamudram, Mithun Saha, Santosh Kumar, James Matthew Rehg

rag multimodal

arXiv AI

Jun 19

SL-S4Wave: Self-Supervised Learning of Physiological Waveforms with Structured State Space Models

arXiv:2606. 19888v1 Announce Type: cross Abstract: Modeling long-sequence medical time series data, such as electrocardiograms (ECG), poses significant challenges due to high sampling rates, multichannel signal complexity, inherent noise, and limited labeled data.

By Feng Wu, Harsh Deep, Eric Lehman, Sanyam Kapoor, Guoshuai Zhao, Rahul Krishnan, Gari Clifford, Li-wei H Lehman

benchmarks

arXiv AI

Aug 7

Is Self-Pretraining really useful to improve diagnosis in medical Time Series?

arXiv:2608. 06122v1 Announce Type: cross Abstract: Inspired by recent evidence that transformer architectures benefit from Self-PreTraining (SPT) on long-context benchmarks, we investigate whether similar gains extend to multimodal, multivariate, and even simple univariate medical time series.

By Omar Coser, Antonio Orvieto, Paolo Soda, Loredana Zollo

llms robotics multimodal benchmarks

arXiv Machine Learning

Jul 16

Hierarchical Self-Supervised Representation Learning Framework for Multivariate Time Series Grounded in ECG Analysis

arXiv:2607. 01145v2 Announce Type: replace Abstract: Data analysis in the medical domain often encounters scenarios involving a limited target dataset and a large, unannotated dataset with a general distribution.

By Siwon Kim

llms rag computer-vision benchmarks

arXiv Machine Learning

Jul 2

A Lightweight Self-Supervised Learning Framework for Multivariate Time Series using Hierarchical-JEPA on ECG Data

arXiv:2607. 01145v1 Announce Type: new Abstract: Data analysis in the medical domain often encounters scenarios involving a limited target dataset and a large, unannotated dataset with a general distribution.

By Siwon Kim

llms rag computer-vision benchmarks

arXiv Machine Learning

Jul 7

Modular Foundation Models for Time-Series Perception in Digital Twins

arXiv:2607. 03585v1 Announce Type: new Abstract: Engineering Digital Twins and Prognostics and Health Management (PHM) systems rely on robust perception modules to extract actionable information from heterogeneous and non-stationary time-series data.

By Quang Hung Pham, Ryad Zemouri, Martin Gagnon, Luc Vouligny

llms diffusion benchmarks safety

arXiv Machine Learning

5d ago

The Impact of Temporal Context Length and Encoding Strategies on Self-Supervised ECG Representation Learning

arXiv:2608. 12695v1 Announce Type: new Abstract: Self-supervised electrocardiogram (ECG) models are often trained on a few seconds of ECG signal and, increasingly, on discretized token sequences.

By Ahmed Sameh, Ramzi Al-Sharawi, Yogatheesan Varatharajah

llms rag efficiency

arXiv AI

Jun 2

Towards a General Intelligence and Interface for Wearable Health Data

arXiv:2605. 22759v2 Announce Type: replace Abstract: While ubiquitous wearable sensors capture a wealth of behavioral and physiological information, effectively transforming these signals into personalized health insights is challenging.

By Girish Narayanswamy, Maxwell A. Xu, A. Ali Heydari, Samy Abdel-Ghaffar, Marius Guerard, Kara Vaillancourt, Zhihan Zhang, Jake Garrison, Levi Albuquerque, Dimitris Spathis, Hong Yu, Hamid Palangi, Xuhai "Orson" Xu, David G. T. Barrett, Joseph Breda, Jed McGiffin, Yubin Kim, Yuwei Zhang, Naghmeh Rezaei, Samuel Solomon, Karan Ahuja, Tim Althoff, Jake Sunshine, Ming-Zher Poh, Benjamin Yetton, Ari Winbush, Nicholas B. Allen, James M. Rehg, Isaac Galatzer-Levy, Yun Liu, John Hernandez, Anupam Pathak, Conor Heneghan, Yuzhe Yang, Ahmed A. Metwally, Pushmeet Kohli, Mark Malhotra, Shwetak Patel, Xin Liu, Daniel McDuff

llms rag agents

arXiv Machine Learning

Jun 16

Towards a Unified Generative Model for Scarce Time Series with Domain Experts

arXiv:2606. 15172v1 Announce Type: new Abstract: Synthesizing realistic time series with generative models has wide-ranging applications in real-world scenarios.

By Zihao Yao, Qi Zheng, Jiankai Zuo, Yaying Zhang

llms diffusion fine-tuning

arXiv AI

Jun 9

Next-Token Prediction Learns Generalisable Representations of Sleep Physiology

arXiv:2606. 09605v1 Announce Type: new Abstract: Foundation models offer a promising route to compress multi-modal physiological signals into compact representations of human health, with broad applications across sleep medicine, cardiology, neurology and other healthcare domains.

By Jonathan F. Carter, Lionel Tarassenko

llms rag efficiency multimodal benchmarks

arXiv Machine Learning

Aug 7

MoCA: Multi-modal Cross-masked Autoencoder for Time Series in Digital Health

arXiv:2506. 02260v5 Announce Type: replace-cross Abstract: Wearable devices enable continuous multi-modal physiological and behavioral monitoring, yet analysis of these data streams faces fundamental challenges including the lack of gold-standard labels and incomplete sensor data.

By Howon Ryu, Yuliang Chen, Yacun Wang, Andrea Z. LaCroix, Chongzhi Di, Loki Natarajan, Yu Wang, Jingjing Zou

llms multimodal benchmarks

arXiv AI

Jun 8

A robust PPG foundation model using multimodal physiological supervision

arXiv:2606. 07365v1 Announce Type: cross Abstract: Photoplethysmography (PPG), a non-invasive measure of changes in blood volume, is widely used in both wearable devices and clinical settings.

By Eloy Geenjaar, Vince Calhoun, Scott Daly, Gouthaman KV, Lie Lu, Trisha Mittal, Daniel P. Darcy

multimodal benchmarks

Related stories