arXiv Machine Learning By Zhengyang (Cissy), Gu, Joseph E. Hernandez, Thomas Cook, John Burtenshaw, Sean Scott, Chris Couch

Benchmarking Hybrid Deep Learning Architectures for Predictive Maintenance in Industry 4.0

Read the original on arXiv Machine Learning →

The study evaluates six deep learning architectures for predictive maintenance in Industry 4.0, focusing on Recurrent Neural Networks (RNNs) and Transformers. It finds that Transformers perform well on stable, slow-moving data but overreact to noisy, chaotic data, whereas a hybrid model combining an LSTM layer with a Transformer layer better filters noise and delivers more consistent predictions. The hybrid approach improves accuracy and reliability across varying levels of data volatility.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
5d ago

FreqCondNorm: Towards Cross-domain Predictive Maintenance through a Frequency-Conditioned Transformer Foundation Model

The paper introduces FreqCondNorm, a Transformer-based architecture that adds a frequency-conditioned normalization layer to unify heterogeneous time-series data for predictive maintenance. The model is pretrained on five public datasets using masked auto‑encoding and contrastive learning, achieving 99.2% accuracy on CWRU and 82.1% zero‑shot accuracy on MFPT, showing strong transfer across sampling frequencies. However, it does not improve remaining useful life prediction, indicating a mismatch between pretraining and RUL objectives that requires further study.

By Zaynab Raounak, Camille LHermine, Zhiguo Zeng
arXiv Machine Learning
Aug 20

An Empirical Benchmark of Deep Time-Series Models for Smart Meter Energy Forecasting

The paper presents an empirical benchmark of nine modern deep‑learning models for time‑series forecasting of smart‑meter energy consumption, evaluated on two publicly available datasets. It examines how historical input length, prediction horizon, and model architecture affect accuracy, finding that longer historical context improves performance up to a saturation point and that accuracy declines with longer horizons. The study also compares computational complexity, showing that lightweight architectures achieve similar performance to heavier models, and notes that model choice has limited impact across most demographic and household subgroups.

By Behnaz Kavoosighafi, Maria Eidenskog, Wiktoria Glad, Katerina Vrotsou
arXiv Machine Learning
Jul 8

Drift Happens: An Empirical Study of Neural Architecture Robustness to Temporal Distribution Shift

arXiv:2607. 05908v1 Announce Type: new Abstract: Real-world data distributions evolve over time, inducing temporal distribution shift that can substantially degrade the reliability of deployed machine learning systems.

By Robin Holzinger (Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA), Riccardo Colletti (Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA)