arXiv AI

FreqCondNorm: Towards Cross-domain Predictive Maintenance through a Frequency-Conditioned Transformer Foundation Model

The paper introduces FreqCondNorm, a Transformer-based architecture that adds a frequency-conditioned normalization layer to unify heterogeneous time-series data for predictive maintenance. The model is pretrained on five public datasets using masked auto‑encoding and contrastive learning, achieving 99.2% accuracy on CWRU and 82.1% zero‑shot accuracy on MFPT, showing strong transfer across sampling frequencies. However, it does not improve remaining useful life prediction, indicating a mismatch between pretraining and RUL objectives that requires further study.

arXiv Machine Learning
1d ago

Benchmarking Hybrid Deep Learning Architectures for Predictive Maintenance in Industry 4.0

The study evaluates six deep learning architectures for predictive maintenance in Industry 4.0, focusing on Recurrent Neural Networks (RNNs) and Transformers. It finds that Transformers perform well on stable, slow-moving data but overreact to noisy, chaotic data, whereas a hybrid model combining an LSTM layer with a Transformer layer better filters noise and delivers more consistent predictions. The hybrid approach improves accuracy and reliability across varying levels of data volatility.

By Zhengyang (Cissy), Gu, Joseph E. Hernandez, Thomas Cook, John Burtenshaw, Sean Scott, Chris Couch
arXiv Machine Learning
Sep 10

PatchFormer: A Patch-Based Time Series Foundation Model with Hierarchical Masked Reconstruction and Cross-Domain Transfer Learning for Zero-Shot Multi-Horizon Forecasting

arXiv:2601.20845v2 Announce Type: replace Abstract: Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require do...

By Olaf Yunus Laitinen Imanov, Derya Umut Kulali, Taner Yilmaz
Hugging Face Trending Papers
Jun 25

A Multi-Fidelity Convolutional Autoencoder-Transfer Learning Framework for Guided-Wave-Based Damage Diagnosis Using Large Simulated and Limited Experimental Datasets

Guided wave-based structural health monitoring (GWSHM) with onboard transducers offers significant potential for the early diagnosis of damage in engineering structures. However, the practical deployment of deep learning models is often hindered by the limited availability of labelled experimental data and the high computational cost of generating large-scale high-fidelity simulation datasets.

arXiv Machine Learning
Jun 10

One Step Closer to Ground Truth: A Multi-Scale Residual-Aware Representation Learning Pipeline for Predicting Time Series Data

arXiv:2606. 10678v1 Announce Type: new Abstract: Transformer-based models have emerged as leading paradigms in time-series forecasting in recent years, employing self-attention mechanisms to capture long-range dependencies.

By Amrijit Biswas, Mustafa Kamal, Robin Krambroeckers, M. M. Lutfe Elahi, Sifat Momen, Nabeel Mohammed, Shafin Rahman