arXiv Machine Learning

Neural Network Implementation of the Renormalization Group for Fault Diagnosis with Class Imbalance

arXiv:2606. 18326v1 Announce Type: new Abstract: The application of machine learning models in practical tasks faces challenges such as class imbalance and multidimensional noise.

arXiv Machine Learning
Jun 19

Evaluating deep learning models for fault diagnosis of a rotating machinery with epistemic and aleatoric uncertainty

arXiv:2412. 18980v2 Announce Type: replace Abstract: Uncertainty-aware deep learning (DL) models recently gained attention in fault diagnosis as a way to promote the reliable detection of faults when out-of-distribution (OOD) data arise from unseen faults (epistemic uncertainty) or the presence of noise (aleatoric uncertainty).

By Reza Jalayer, Masoud Jalayer, Andrea Mor, Carlotta Orsenigo, Carlo Vercellis
arXiv Machine Learning
Sep 22

Contrastive Siamese Representation Learning for Predictive Maintenance of Electrical Submersible Pumps

The paper introduces a fault‑diagnosis framework for electrical submersible pumps that uses Siamese contrastive representation learning to handle class imbalance and a prior‑corrected k‑nearest neighbor classifier for robust fault classification. It extracts discriminative vibration‑domain features, trains a Siamese network to cluster same‑fault samples, and applies a distance‑weighted KNN to mitigate imbalance. Validation with a Leave‑One‑ESP‑Out strategy shows consistent performance across unseen pump units, indicating potential for reliable predictive maintenance in offshore oil production.

By Seshu K. Damarla, Xiuli Zhu
arXiv AI
Jun 2

Interpreting FCDNNs via RG on Exponential Family

arXiv:2606. 00157v1 Announce Type: cross Abstract: We consider establishing the interpretability theory of deep learning through constructing a corresponding relationship between the renormalization group (RG) method in statistical physics and the training process of deep neural networks (DNNs).

By Fuzhou Gong, Zigeng Xia
arXiv Machine Learning
Jun 10

Rank Collapse, Fixed Points, and the Renormalization Group Structure of MLP Residual Networks

arXiv:2606. 10324v1 Announce Type: new Abstract: The analogy between deep neural network forward passes and renormalization group (RG) flows has been repeatedly noted in the literature, but existing treatments remain qualitative: depth is described as a coarse-graining scale, attention is likened to a partition function, and representations are said to flow toward fixed points.

By Parviz Haggi-Mani, Irina Rish