arXiv Machine Learning

Characterizing Cross-Relay Generalization Failure in Machine Learning-Based Power System Protection

The study examines how machine‑learning fault detectors trained on data from specific relay locations perform when applied to other relays in a 110 kV transmission network. Using 50 ms windows and a multilayer perceptron, the authors evaluate all 64 source–target relay combinations and find that overall F1‑scores remain similar, but the false‑positive rate rises markedly while the false‑negative rate falls when models are transferred across relays. Analysis shows that models retain coarse bus‑group information, and that aggregate metrics can mask location‑specific changes in false‑alarm behavior, underscoring the need to assess error types separately for cross‑relay generalization.

arXiv Machine Learning
Sep 24

EvEMTBench: An Open Benchmark for Machine Learning in Power System Protection

EvEMTBench is an open, executable, and versioned benchmark designed to standardize the evaluation of machine‑learning methods for power system protection. It defines 12 protection and event‑analysis functions across four grids (20–345 kV) as 24 scored tasks, enabling structured assessment under varied observability, distribution shifts, and cross‑grid transfer scenarios. The benchmark includes committed data partitions, leakage controls, and reproducible reporting, and demonstrates that wider observability does not always help, that shifted conditions expose hidden failures, and that fault detection transfers better than fault localization.

By Julian Oelhaf, Georg Kordowich, Christian Bergler, Andreas Maier, Johann J\"ager, Siming Bayer
arXiv Machine Learning
Sep 16

A Systematic Evaluation of Machine Learning Methods for Fault Detection and Line Identification in Electrical Power Grids

arXiv:2609.16744v1 Announce Type: new Abstract: The integration of renewable energy sources into the electrical grid introduces complex challenges in fault detection and coordination of grid recovery...

By Julian Oelhaf, Georg Kordowich, Paula Andrea P\'erez-Toro, Tom\'as Arias-Vergara, Andreas Maier, Johann J\"ager, Siming Bayer
arXiv AI
Jun 19

Controlled Comparison of Machine Learning Models for Fault Classification and Localization in Power System Protection

arXiv:2510. 00831v2 Announce Type: replace Abstract: The increasing complexity of modern power systems, driven by the integration of inverter-based and distributed energy resources, challenges the reliability of conventional protection schemes and motivates the use of machine learning for protection tasks.

By Julian Oelhaf, Georg Kordowich, Changhun Kim, Paula Andrea P\'erez-Toro, Christian Bergler, Andreas Maier, Johann J\"ager, Siming Bayer
arXiv Machine Learning
Aug 26

A Hybrid Two-Stage Machine Learning Pipeline for Fault Detection and Classification in Power Transmission Systems

The paper introduces a hybrid two‑stage machine learning pipeline for fault detection and classification in high‑voltage transmission networks. Stage 1 uses an Isolation Forest anomaly detector combined with an optional supervised binary detector, while Stage 2 applies a Random Forest multiclass classifier only to samples flagged by Stage 1. Feature engineering maps six raw channels to eighteen features, including zero‑sequence symmetrical components, achieving end‑to‑end accuracies of 95.8 % on the TLFaultDataset and 97.25 % on an independent single‑point dataset, surpassing federated benchmarks without GPU or federated infrastructure.

By Sahil Manikshete, Atharva Gujarathi, Thanh Long Vu, Akhtar Hussain, Van-Hai Bui
arXiv Machine Learning
Sep 22

Offline Reinforcement Learning for Distribution-Grid Protection

The paper investigates using offline reinforcement learning to improve line‑selective tripping in distribution grids. A convolutional Q‑network trained with conservative Q‑learning (CQL) processes voltage‑current phasor and impedance data, optionally with raw waveforms, to predict faulted lines. On a realistic CIGRE medium‑voltage network, the best model achieved high per‑timestep precision, recall, and F1‑score, and correctly identified the first trip action in over 98% of fault episodes, though it mis‑tripped in a notable fraction of non‑fault cases.

By Julian Oelhaf, Alexander Luce, Christian Bergler, Andreas Maier, Siming Bayer
arXiv AI
Sep 7

Data-Optimized Contingency Screening: A Machine Learning Approach to Power System Security

The paper presents a machine‑learning framework for classifying power‑system contingencies into safe, moderate, or severe categories. Using Newton‑Raphson load flow data, the study applies SMOTE, PCA, and classifiers (KNN, Random Forest, SVM) to IEEE‑14 and IEEE‑30 bus systems, evaluating performance with precision, recall, and F1 score. Random Forest achieved the highest F1 scores, while PCA improved overall performance more than SMOTE, which boosted recall at the cost of some false positives.

By Joshua Salako, Folajimi Osikomaiya, Olakorede Olamiju
arXiv AI
Sep 15

A Three-Axis Stress Test of LLM vs Classical ML for Network Intrusion Detection under Distribution Shift and Adversarial Evasion

The study compares XGBoost and RoBERTa‑LoRA for network intrusion detection across three evaluation axes: same‑dataset performance, cross‑dataset transfer, and adversarial evasion. Both models perform similarly on the same dataset, but XGBoost outperforms RoBERTa‑LoRA by 15 F1 points and 25 balanced accuracy points when transferred to a different network, while RoBERTa‑LoRA wins by about 17 F1 points under adversarial evasion. Feature‑leakage ablation shows that cross‑dataset transfer improvements are non‑monotonic and directional, suggesting leakage is spread across features rather than isolated. "whyItMatters":"The findings demonstrate that a model’s superiority depends on the specific robustness axis evaluated, underscoring the need for multi‑axis, multi‑metric testing in network intrusion detection research."

By Muhammad Ebad Atif, Muhammad Haider Ali
arXiv Machine Learning
Sep 7

Candidate Comparability Before Promotion: Conditional Validation in Adaptive Network Intrusion Detection

The paper investigates how to properly validate candidate models before promoting them to replace incumbent classifiers in adaptive network intrusion detection systems. It demonstrates that promotion decisions can be biased by how challengers are constructed and the amount of evidence they receive, and that using self‑contained challenger pipelines and sufficient candidate evidence reduces apparent promotion harm. The study also shows that policy rankings shift with candidate comparability and that no single update policy dominates across benchmarks.

By Roberto Fern\'andez-Barrios, Iker Pastor-L\'opez, Amaia Pikatza-Huerga, Pablo Garc\'ia Bringas