arXiv AI

Learning-based Probabilistic Load Forecasting with Post-hoc and In-model Uncertainty

arXiv:2607. 12730v1 Announce Type: cross Abstract: Smart-building load forecasters are often trained offline on dense, multivariate, high-frequency data, but deployment may provide only hourly, feature-limited inputs.

arXiv Machine Learning
5d ago

Aurora-X: Built for Extreme Time Series Forecasting

Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.

By Xingjian Wu, Chenjuan Guo, Xiangfei Qiu, Zhigang Hu, Hanyin Cheng, Peng Chen, Yang Shu, Jilin Hu, Bin Yang
arXiv Machine Learning
Jun 10

One Step Closer to Ground Truth: A Multi-Scale Residual-Aware Representation Learning Pipeline for Predicting Time Series Data

arXiv:2606. 10678v1 Announce Type: new Abstract: Transformer-based models have emerged as leading paradigms in time-series forecasting in recent years, employing self-attention mechanisms to capture long-range dependencies.

By Amrijit Biswas, Mustafa Kamal, Robin Krambroeckers, M. M. Lutfe Elahi, Sifat Momen, Nabeel Mohammed, Shafin Rahman
arXiv AI
Sep 7

Long Horizon Transformer Quantile Fault Prediction for Multi Site Industrial Predictive Maintenance

The paper introduces TQRNN30d, a long‑horizon predictive maintenance model that uses a dual‑stage quantile regression neural network to transform hourly machine data into a 324‑dimensional quantile‑state representation, which is then classified with a multi‑stream temporal fusion architecture. Trained on data from 72 machines across nine facilities, the model achieves high performance at 30‑day horizons (F1 ≈ 80%, recall ≈ 80%, precision ≈ 82%, accuracy ≈ 82%, ROC‑AUC ≈ 0.82) and outperforms 18 baseline methods at 7‑, 14‑, and 30‑day thresholds. The study demonstrates that explicit conditional‑quantile representations can effectively distinguish gradual degradation from normal operation over multi‑day planning windows, though generalisation to unseen sites or equipment remains untested.

By David J Poland, Daniele Ravi, Na Helian
arXiv AI
Sep 10

Quantile-Led Feature Extraction for Multi-Horizon Predictive Maintenance in Industrial Manufacturing Systems

The paper introduces a quantile‑led feature‑extraction framework for predictive maintenance that separates representation learning from downstream modeling. Using a dual‑stage MLP‑QRNN hierarchy, it learns a ten‑quantile distribution per sensor and refines a mid‑tail quantile set into compact, channel‑resolved features. Experiments on 72 machines across nine facilities show that increasing the retained mid‑tail quantiles improves short‑term F1 scores, and that horizon‑conditioned extractors outperform a fixed short‑horizon extractor, demonstrating that feature extraction should be horizon‑dependent rather than fixed preprocessing.

By David J Poland, Daniele Ravi, Na Helian
arXiv Machine Learning
Aug 20

An Empirical Benchmark of Deep Time-Series Models for Smart Meter Energy Forecasting

The paper presents an empirical benchmark of nine modern deep‑learning models for time‑series forecasting of smart‑meter energy consumption, evaluated on two publicly available datasets. It examines how historical input length, prediction horizon, and model architecture affect accuracy, finding that longer historical context improves performance up to a saturation point and that accuracy declines with longer horizons. The study also compares computational complexity, showing that lightweight architectures achieve similar performance to heavier models, and notes that model choice has limited impact across most demographic and household subgroups.

By Behnaz Kavoosighafi, Maria Eidenskog, Wiktoria Glad, Katerina Vrotsou
arXiv Machine Learning
Jul 20

Boosted Enhanced Quantile Regression Neural Networks with Spatiotemporal Permutation Entropy for Complex System Prognostics

arXiv:2507. 14194v3 Announce Type: replace-cross Abstract: This paper presents an integrative prognostic framework that combines Spatiotemporal Permutation Entropy (STPE), Boosted Enhanced Quantile Regression Neural Networks (B-EQRNNs), Gated Temporal Attention, a Spiking Neural Network (SNN) refinement stage, and a Temporal Fusion Transformer (TFT) classifier.

By David J Poland