arXiv Machine Learning

Federated Physics-Grounded Reinforcement Learning for Distributed Stability Control in Smart Grids

arXiv:2607. 05553v1 Announce Type: new Abstract: Transient stability control in smart grids requires rapid post-fault damping of generator frequency and rotor angle deviations to prevent cascading failures.

arXiv AI
Jul 15

Constraint-Aware Aggregation for Federated Reinforcement Learning in Microgrid Energy Coordination

arXiv:2607. 12763v1 Announce Type: cross Abstract: Federated Reinforcement Learning (FedRL) enables coordination of distributed energy resources without sharing raw local data, but standard aggregation methods such as FedAvg do not account for system-level constraints, often leading to unsafe global behavior.

By Usman Haider, Karl Mason
arXiv Machine Learning
Sep 22

Offline Reinforcement Learning for Distribution-Grid Protection

The paper investigates using offline reinforcement learning to improve line‑selective tripping in distribution grids. A convolutional Q‑network trained with conservative Q‑learning (CQL) processes voltage‑current phasor and impedance data, optionally with raw waveforms, to predict faulted lines. On a realistic CIGRE medium‑voltage network, the best model achieved high per‑timestep precision, recall, and F1‑score, and correctly identified the first trip action in over 98% of fault episodes, though it mis‑tripped in a notable fraction of non‑fault cases.

By Julian Oelhaf, Alexander Luce, Christian Bergler, Andreas Maier, Siming Bayer
arXiv Machine Learning
Jun 18

Model-Free Reinforcement Learning Control for Resilient Cyber-Physical Systems

arXiv:2606. 19069v1 Announce Type: cross Abstract: This paper compares the performance of model-free controllers on a nonlinear system under cyberattacks, including false data injection and denial-of-service attacks.

By Hugo O. Garc\'es, Alejandro J. Rojas, Bernardo A. Hern\'andez, Andr\'es Escalona, Jonathan M. Palma, Md. Rezwan Parvez, Bhushan Gopaluni, Sirish L. Shah
arXiv AI
Jul 20

Robustness of Reinforcement Learning-Based Congestion Management in Low-Voltage Grids

arXiv:2607. 16004v1 Announce Type: cross Abstract: Increases in photovoltaic generation, charging of electric vehicles and heat-pump demand challenge operating limits in low-voltage distribution grids.

By Josef Hoppe, Sarra Bouchkati, Farah Nasr, Jonathan Krapp, Alexander Och, Maximilian Wirth, Jan Schiefelbein-Lach, Oliver Pohl, Andreas Ulbig, Michael T. Schaub
arXiv AI
4d ago

PowerZooJax: A JAX-based Power System Benchmark for Reinforcement Learning

PowerZooJax is a JAX-based benchmark suite designed for reinforcement learning in power system operation. It offers five constrained Markov decision process tasks covering generation, transmission, distribution, distributed energy resources, and data center microgrids. By implementing power flow, economic dispatch, market clearing, and device dynamics as JAX computation graphs, the entire training and evaluation loop runs on the GPU, yielding significant speedups over CPU-based simulations and enabling standardized evaluation of policy returns, safety violations, and out-of-distribution stress conditions.

By Zhanhua Pan, Xiao Liu, Zhilong Cao, Jianhong Wang, Dawei Qiu