arXiv AI

Long Horizon Transformer Quantile Fault Prediction for Multi Site Industrial Predictive Maintenance

The paper introduces TQRNN30d, a long‑horizon predictive maintenance model that uses a dual‑stage quantile regression neural network to transform hourly machine data into a 324‑dimensional quantile‑state representation, which is then classified with a multi‑stream temporal fusion architecture. Trained on data from 72 machines across nine facilities, the model achieves high performance at 30‑day horizons (F1 ≈ 80%, recall ≈ 80%, precision ≈ 82%, accuracy ≈ 82%, ROC‑AUC ≈ 0.82) and outperforms 18 baseline methods at 7‑, 14‑, and 30‑day thresholds. The study demonstrates that explicit conditional‑quantile representations can effectively distinguish gradual degradation from normal operation over multi‑day planning windows, though generalisation to unseen sites or equipment remains untested.

arXiv AI
Sep 10

Quantile-Led Feature Extraction for Multi-Horizon Predictive Maintenance in Industrial Manufacturing Systems

The paper introduces a quantile‑led feature‑extraction framework for predictive maintenance that separates representation learning from downstream modeling. Using a dual‑stage MLP‑QRNN hierarchy, it learns a ten‑quantile distribution per sensor and refines a mid‑tail quantile set into compact, channel‑resolved features. Experiments on 72 machines across nine facilities show that increasing the retained mid‑tail quantiles improves short‑term F1 scores, and that horizon‑conditioned extractors outperform a fixed short‑horizon extractor, demonstrating that feature extraction should be horizon‑dependent rather than fixed preprocessing.

By David J Poland, Daniele Ravi, Na Helian
arXiv Machine Learning
Jul 20

Boosted Enhanced Quantile Regression Neural Networks with Spatiotemporal Permutation Entropy for Complex System Prognostics

arXiv:2507. 14194v3 Announce Type: replace-cross Abstract: This paper presents an integrative prognostic framework that combines Spatiotemporal Permutation Entropy (STPE), Boosted Enhanced Quantile Regression Neural Networks (B-EQRNNs), Gated Temporal Attention, a Spiking Neural Network (SNN) refinement stage, and a Temporal Fusion Transformer (TFT) classifier.

By David J Poland
arXiv Machine Learning
Jul 21

Leakage-Robust Evaluation and Data-Scale Sensitivity of Attention-Enhanced Multi-Task Learning for Joint Fault Diagnosis and Remaining Useful Life Estimation

arXiv:2607. 16493v1 Announce Type: new Abstract: Multi-task deep learning models that jointly perform fault classification and remaining useful life (RUL) regression are increasingly used in predictive maintenance, yet reported performance can be strongly affected by how sliding-window sequences are split into training and test sets.

By Md Mahamudur Rahaman Shamim, Md. Nuruzzaman, Zannatul Ferdus, Md Rajib Ahmed, Abieer Nwshad Anward, Mohammad Tooneer, Johir Uddin Khan, Khalid Hossen
arXiv Machine Learning
1d ago

Uncertainty and Business-Aware Remaining Useful Life Estimation for Semiconductor Manufacturing

The paper presents a predictive maintenance framework for semiconductor manufacturing that combines deep learning sequence models with simultaneous quantile regression to provide uncertainty‑aware remaining useful life (RUL) estimates. It evaluates several architectures—including state‑space models—on ion‑milling data from the 2018 PHM Data Challenge, showing that the Diagonal State Space (S4D) model delivers the most accurate RUL predictions across quantiles. Compared to preventive maintenance baselines, the S4D approach significantly reduces business costs by avoiding unnecessarily early interventions.

By Davide Frizzo, Francesco Borsatti, Gian Antonio Susto
arXiv Machine Learning
1d ago

Benchmarking Hybrid Deep Learning Architectures for Predictive Maintenance in Industry 4.0

The study evaluates six deep learning architectures for predictive maintenance in Industry 4.0, focusing on Recurrent Neural Networks (RNNs) and Transformers. It finds that Transformers perform well on stable, slow-moving data but overreact to noisy, chaotic data, whereas a hybrid model combining an LSTM layer with a Transformer layer better filters noise and delivers more consistent predictions. The hybrid approach improves accuracy and reliability across varying levels of data volatility.

By Zhengyang (Cissy), Gu, Joseph E. Hernandez, Thomas Cook, John Burtenshaw, Sean Scott, Chris Couch
arXiv AI
5d ago

FreqCondNorm: Towards Cross-domain Predictive Maintenance through a Frequency-Conditioned Transformer Foundation Model

The paper introduces FreqCondNorm, a Transformer-based architecture that adds a frequency-conditioned normalization layer to unify heterogeneous time-series data for predictive maintenance. The model is pretrained on five public datasets using masked auto‑encoding and contrastive learning, achieving 99.2% accuracy on CWRU and 82.1% zero‑shot accuracy on MFPT, showing strong transfer across sampling frequencies. However, it does not improve remaining useful life prediction, indicating a mismatch between pretraining and RUL objectives that requires further study.

By Zaynab Raounak, Camille LHermine, Zhiguo Zeng