arXiv AI

FreqCondNorm: Towards Cross-domain Predictive Maintenance through a Frequency-Conditioned Transformer Foundation Model

The paper introduces FreqCondNorm, a Transformer-based architecture that adds a frequency-conditioned normalization layer to unify heterogeneous time-series data for predictive maintenance. The model is pretrained on five public datasets using masked auto‑encoding and contrastive learning, achieving 99.2% accuracy on CWRU and 82.1% zero‑shot accuracy on MFPT, showing strong transfer across sampling frequencies. However, it does not improve remaining useful life prediction, indicating a mismatch between pretraining and RUL objectives that requires further study.

arXiv Machine Learning
Sep 22

Benchmarking Hybrid Deep Learning Architectures for Predictive Maintenance in Industry 4.0

The study evaluates six deep learning architectures for predictive maintenance in Industry 4.0, focusing on Recurrent Neural Networks (RNNs) and Transformers. It finds that Transformers perform well on stable, slow-moving data but overreact to noisy, chaotic data, whereas a hybrid model combining an LSTM layer with a Transformer layer better filters noise and delivers more consistent predictions. The hybrid approach improves accuracy and reliability across varying levels of data volatility.

By Zhengyang (Cissy), Gu, Joseph E. Hernandez, Thomas Cook, John Burtenshaw, Sean Scott, Chris Couch
arXiv Machine Learning
Sep 10

PatchFormer: A Patch-Based Time Series Foundation Model with Hierarchical Masked Reconstruction and Cross-Domain Transfer Learning for Zero-Shot Multi-Horizon Forecasting

arXiv:2601.20845v2 Announce Type: replace Abstract: Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require do...

By Olaf Yunus Laitinen Imanov, Derya Umut Kulali, Taner Yilmaz
Hugging Face Trending Papers
Jun 25

A Multi-Fidelity Convolutional Autoencoder-Transfer Learning Framework for Guided-Wave-Based Damage Diagnosis Using Large Simulated and Limited Experimental Datasets

Guided wave-based structural health monitoring (GWSHM) with onboard transducers offers significant potential for the early diagnosis of damage in engineering structures. However, the practical deployment of deep learning models is often hindered by the limited availability of labelled experimental data and the high computational cost of generating large-scale high-fidelity simulation datasets.

arXiv AI
Sep 28

Factorized axis convolutional gated recurrent unit with dynamic adaptive pooling for remaining useful life prediction of rolling bearings

The paper presents a factorized-axis convolutional gated recurrent unit (GRU) with dynamic adaptive pooling (DAP) for predicting the remaining useful life (RUL) of rolling bearings from time‑frequency representations (TFRs). It introduces multiscale anisotropic convolution, a dual‑axis convolution block attention module, and Monte Carlo dropout for uncertainty estimation, addressing the directional structure challenges in TFRs. Experiments on two public bearing datasets show that this approach outperforms existing RUL prediction methods and that the factorized axis design and adaptive pooling contribute to lower mean errors.

By Hanbyeol Park, Jungho Choo, Hyerim Bae