arXiv AI
Sep 16

Continuous-Time Machine Learning: A Unified Mathematical Perspective

The paper surveys continuous‑time (CT) machine learning, a framework for modeling temporal dynamics as continuous processes, especially useful when data are sampled irregularly or over long horizons. It introduces a unified taxonomy that groups major CT methods by their underlying mathematical formulations and shows how different architectural choices—such as vector‑field parameterization, stochasticity, memory mechanisms, and discretization—relate these families. The survey compares training algorithms, optimization strategies, failure modes, computational complexity, and benchmarks, reviews supporting software ecosystems, and outlines open challenges and future research directions.

By Waleed Razzaq, Yun-Sheng Zhao, Yun-Bo Zhao
arXiv Machine Learning
Oct 12

Fast Gradient-Based Approximation of Continuous Dynamic Time Warping

The paper introduces FastCDTW, an efficient approximation for Continuous Dynamic Time Warping (CDTW). It offers two computational strategies: an exact closed‑form solution for piecewise‑linear warping functions and an unbiased Monte Carlo estimator for smooth warping functions such as those implemented by implicit neural networks. Both approaches provide gradients with respect to the warping function and the input time series, making the algorithm GPU‑friendly and suitable for integration into complex learning tasks like time‑series averaging, classification, and deep domain adaptation.

By Pierre Houedry, Romain Tavenard, Nicolas Courty, Romaric Gaudel