The paper presents a reinforcement learning framework for strategic investment decisions in the energy transition, aiming to balance profit, CO2 social costs, and competitive advantage across oil & gas, renewables, and CO2 reduction sectors. A custom simulation environment models the dynamic energy landscape up to 2050, allowing the RL agent to learn optimal policies that adapt to uncertainties in production, prices, and costs. Benchmarking shows the RL strategy consistently outperforms manually defined baseline policies in adaptability and long-term value creation.
arXiv:2606. 02049v1 Announce Type: new Abstract: The increasing integration of renewable energy sources into power systems, particularly in buildings equipped with photovoltaic (PV) panels and energy storage systems, introduces significant complexity in energy systems.
arXiv:2601.03679v2 Announce Type: replace-cross Abstract: Decarbonization of isolated or off-grid energy systems through phase-in of large shares of intermittent solar or wind generation requires co-...
The paper presents a reinforcement learning framework for designing solar PV adoption policies under uncertainty, integrating RL with a stochastic agent‑based model to simulate yearly adoption over a 16‑year horizon. Policymakers can choose annual incentives such as grants, subsidised loans, and feed‑in tariffs, and the study evaluates three RL algorithms—PPO, SAC, and TD3—within a scalarised reward framework that balances adoption gains against costs. Results show clear trade‑off patterns, with TD3 yielding the highest adoption at higher cost, PPO achieving the lowest cost with fewer adopters, and a balanced PPO policy offering a middle ground, all outperforming static baseline policies.
This study evaluates four control strategies—rule-based, model predictive control (MPC), reinforcement learning without forecasts (RL‑NF), and reinforcement learning with forecasts (RL‑F)—for a renewable‑powered hydrogen supply chain. Using a unified, physically realistic simulation that includes electrolyzer constraints, storage dynamics, and grid limits, the authors find that MPC delivers the best economic performance by leveraging short‑term forecasts, while RL‑NF performs robustly without future information. RL‑F does not consistently outperform RL‑NF, indicating that forecast uncertainty and added state complexity can hinder forecast‑augmented learning.
arXiv:2606. 24947v1 Announce Type: new Abstract: The increasing integration of distributed energy resources (DERs) is crucial for power system decarbonization, yet unlocking DERs' flexibility is challenged by their inherent uncertainties and modelling complexity.
arXiv:2608. 09335v1 Announce Type: new Abstract: Multistage stochastic model predictive control (MPC) handles uncertainty by optimizing over a scenario tree, a finite branching approximation of future outcomes constructed from sampled forecasts.
arXiv:2606. 30316v1 Announce Type: new Abstract: This paper studies Reinforcement Learning as an online controller for curtailment-aware workload shifting in wind-turbine-integrated high-performance computing (HPC) data centers.
arXiv:2609.37065v1 Announce Type: new Abstract: Decision-making under uncertainty often relies on predicted parameters, yet accurate prediction does not necessarily lead to good operational decisions...
This paper studies Reinforcement Learning as an online controller for curtailment-aware workload shifting in wind-turbine-integrated high-performance computing (HPC) data centers. We introduce a reproducible fixed-day simulation framework with synthetic wind and price signals and delayed completion feedback, designed to be extensible toward more complex scenarios.
Multistage stochastic model predictive control (MPC) handles uncertainty by optimizing over a scenario tree, a finite branching approximation of future outcomes constructed from sampled forecasts. To build such a tree, conventional methods focus on matching the underlying probability distribution---e.
arXiv:2505. 05203v3 Announce Type: replace-cross Abstract: With the increasing penetration of renewable energy and inverter-based resources, traditional physics-based power-system operation faces growing challenges in maintaining economic efficiency, security, and robustness.
arXiv:2607. 06121v1 Announce Type: cross Abstract: In this paper, we investigate whether a model-free RL agent can identify and exploit price manipulation opportunities more effectively than a traditional model-based approach that assumes correct specification of the data-generating process but relies on noisy parameter estimates.