arXiv AI

Optimizing Transformer Neural Network for Real-Time Outlier Detection on FPGAs

arXiv:2607. 22786v1 Announce Type: cross Abstract: In this work, we explore how the inference time of a Transformer Neural Network can be efficiently optimized with applications to real-time anomaly detection in financial time series.

arXiv AI
Jul 2

PaAno: Patch-Based Representation Learning for Time-Series Anomaly Detection

arXiv:2602. 01359v3 Announce Type: replace-cross Abstract: Although recent studies on time-series anomaly detection have increasingly adopted ever-larger neural network architectures such as transformers and foundation models, they incur high computational costs and memory usage, making them impractical for real-time and resource-constrained scenarios.

By Jinju Park, Seokho Kang
arXiv AI
Jun 12

ASTER: Latent Pseudo-Anomaly Generation for Unsupervised Time-Series Anomaly Detection

arXiv:2604. 13924v3 Announce Type: replace-cross Abstract: Time-series anomaly detection (TSAD) is critical in domains such as industrial monitoring, healthcare, and cybersecurity, but it remains challenging due to rare and heterogeneous anomalies and the scarcity of labelled data.

By Romain Hermary, Samet Hicsonmez, Dan Pineau, Abd El Rahman Shabayek, Djamila Aouada
Hugging Face Trending Papers
Aug 3

CARE: A Cascaded Framework for Efficient and Reliable Time Series Anomaly Detection

While deep learning models have achieved state-of-the-art performance in time series anomaly detection, their complex architectures incur substantial inference overhead. Existing methods typically apply a uniform inference strategy across all data points, which is inefficient given that anomalies are inherently scarce and the vast majority of temporal data consists of predictable normal patterns.

arXiv Machine Learning
Sep 11

BiHDTrans: binary hyperdimensional transformer for efficient multivariate time series classification

BiHDTrans is a neurosymbolic binary hyperdimensional transformer that merges self‑attention with hyperdimensional computing to classify multivariate time series efficiently. It surpasses existing HD models by at least 14.47% and binary transformers by 6.67% on average, while an FPGA‑accelerated implementation reduces inference latency 39.4× compared to state‑of‑the‑art binary transformers. Even with a 64% reduction in hyperspace dimensionality, BiHDTrans remains competitive, achieving 1–2% higher accuracy with 4.4× smaller model size and nearly 50% lower latency than the full‑dimensional baseline.

By Jingtao Zhang, Yi Liu, Qi Shen, Changhong Wang