arXiv Machine Learning By David J Poland

Boosted Enhanced Quantile Regression Neural Networks with Spatiotemporal Permutation Entropy for Complex System Prognostics

Read the original on arXiv Machine Learning →

arXiv:2507. 14194v3 Announce Type: replace-cross Abstract: This paper presents an integrative prognostic framework that combines Spatiotemporal Permutation Entropy (STPE), Boosted Enhanced Quantile Regression Neural Networks (B-EQRNNs), Gated Temporal Attention, a Spiking Neural Network (SNN) refinement stage, and a Temporal Fusion Transformer (TFT) classifier.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 7

Long Horizon Transformer Quantile Fault Prediction for Multi Site Industrial Predictive Maintenance

The paper introduces TQRNN30d, a long‑horizon predictive maintenance model that uses a dual‑stage quantile regression neural network to transform hourly machine data into a 324‑dimensional quantile‑state representation, which is then classified with a multi‑stream temporal fusion architecture. Trained on data from 72 machines across nine facilities, the model achieves high performance at 30‑day horizons (F1 ≈ 80%, recall ≈ 80%, precision ≈ 82%, accuracy ≈ 82%, ROC‑AUC ≈ 0.82) and outperforms 18 baseline methods at 7‑, 14‑, and 30‑day thresholds. The study demonstrates that explicit conditional‑quantile representations can effectively distinguish gradual degradation from normal operation over multi‑day planning windows, though generalisation to unseen sites or equipment remains untested.

By David J Poland, Daniele Ravi, Na Helian
arXiv AI
Sep 10

Quantile-Led Feature Extraction for Multi-Horizon Predictive Maintenance in Industrial Manufacturing Systems

The paper introduces a quantile‑led feature‑extraction framework for predictive maintenance that separates representation learning from downstream modeling. Using a dual‑stage MLP‑QRNN hierarchy, it learns a ten‑quantile distribution per sensor and refines a mid‑tail quantile set into compact, channel‑resolved features. Experiments on 72 machines across nine facilities show that increasing the retained mid‑tail quantiles improves short‑term F1 scores, and that horizon‑conditioned extractors outperform a fixed short‑horizon extractor, demonstrating that feature extraction should be horizon‑dependent rather than fixed preprocessing.

By David J Poland, Daniele Ravi, Na Helian
arXiv Machine Learning
5d ago

Aurora-X: Built for Extreme Time Series Forecasting

Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.

By Xingjian Wu, Chenjuan Guo, Xiangfei Qiu, Zhigang Hu, Hanyin Cheng, Peng Chen, Yang Shu, Jilin Hu, Bin Yang
arXiv Machine Learning
Sep 15

FlowTSFM: Turning Encoder Depth into Quantile Transport

arXiv:2609.13640v1 Announce Type: new Abstract: Encoder-based time series foundation models (TSFMs) typically rely on deep stacks of independently parameterized Transformer layers, where only the fin...

By Bahaeddine Abdessalem, Shifeng Xie, Zehao Xiao, Youssef Attia El Hili, Ambroise Odonnat, Jianfeng Zhang, Lujia Pan, Keli Zhang, Malik Tiomoko