arXiv AI

Smart charging of large fleets of Electric Vehicles: Independent Multi-Agent Reinforcement Learning approaches

arXiv:2606. 31347v1 Announce Type: new Abstract: The electrification of transportation through electric vehicles introduces new challenges for power grid management, such as increased peak demand, voltage fluctuations, line overloads, and the integration of variable renewable energy sources.

arXiv AI
Sep 15

LLM-Enhanced Multi-Agent Reinforcement Learning for Unified Electric Vehicles-Charging Station-Grid Optimization in Public Charging Systems

The paper introduces a Large Language Model–enhanced Multi-Agent Reinforcement Learning framework for optimizing electric vehicle charging, station profitability, and grid stability in public charging systems. By using an LLM to select interpretable features from IoT data and dynamically balance conflicting objectives, the approach unifies grid, EV, and station optimization in a single loop. Experiments show the method outperforms existing baselines, improving market efficiency and cutting training time by more than 70%.

By Yang Zhang, Lindong Xie, Chongyu Wang, Gaojunjie Li, Siqi Bu, Edward Chung
arXiv Machine Learning
Aug 27

Simulating Cognitive Smart Freight Corridors with Agent-Based Models and Reinforcement Learning

The paper introduces an agent‑based modeling framework that integrates a physical infrastructure layer, a V2X connectivity layer, and a decision layer using reinforcement learning and multi‑agent reinforcement learning to simulate smart freight corridors. Three scenarios—Baseline, Assisted, and Cognitive—are evaluated on throughput, congestion, energy, emissions, and robustness, with the Cognitive scenario outperforming the baseline in throughput and congestion, and the Assisted scenario achieving energy savings via platooning. Sensitivity analysis shows that the smart corridor’s throughput advantage grows under high demand and that MARL coordination better utilizes fixed charging capacity than rule‑based methods.

By Madelaine Martinez-Ferguson, Chun Wang, Mustafa Can Camur, Xueping Li
arXiv AI
Jul 20

Robustness of Reinforcement Learning-Based Congestion Management in Low-Voltage Grids

arXiv:2607. 16004v1 Announce Type: cross Abstract: Increases in photovoltaic generation, charging of electric vehicles and heat-pump demand challenge operating limits in low-voltage distribution grids.

By Josef Hoppe, Sarra Bouchkati, Farah Nasr, Jonathan Krapp, Alexander Och, Maximilian Wirth, Jan Schiefelbein-Lach, Oliver Pohl, Andreas Ulbig, Michael T. Schaub
arXiv Machine Learning
4d ago

OpenHail: An Event-Driven Gymnasium Environment for Electric Ride-Hailing Fleet Control

OpenHail is an open-source Gymnasium environment designed for controlling electric ride‑hailing fleets. It offers a fixed‑size observation–action interface that handles request assignment, repositioning, and charging, while its event‑driven simulator models pickup deadlines, vehicle job queues, battery dynamics, and finite‑capacity charging facilities with FIFO queues. The environment supports various decision‑epoch mechanisms—event‑driven, periodic, hybrid, and policy‑requested—allowing flexible policy interactions within a unified operational model, and includes tools for evaluation, metrics, and baseline policies.

By Tommaso Schettini, Nicholas D. Kullman, Jorge E. Mendoza
arXiv Machine Learning
Jun 25

Supervised Reinforcement Learning for the Coordination of Distributed Energy Resources

arXiv:2606. 24947v1 Announce Type: new Abstract: The increasing integration of distributed energy resources (DERs) is crucial for power system decarbonization, yet unlocking DERs' flexibility is challenged by their inherent uncertainties and modelling complexity.

By Haoyuan Deng, Yihong Zhou, Thomas Morstyn, Yi Wang
arXiv Machine Learning
Sep 3

Reinforcement Learning and Rule-Based Peer-to-Peer Pricing in Residential PV-BES Communities

The paper compares rule‑based and reinforcement‑learning (RL) pricing mechanisms for peer‑to‑peer electricity trading in residential photovoltaic communities. Rule‑based benchmarks—bill‑sharing, mid‑market rate, and supply‑demand‑ratio pricing—outperform the best RL policy in a PV‑only setup, while RL policies achieve higher community savings when battery storage is added. Across both configurations, SDR‑shaped pricing outperforms multiplier‑based parameterization, but benefit distribution remains heterogeneous among households.

By Pablo Benalcazar, Maciej Kalka, Wilian Guam\'an, Jacek Kami\'nski
arXiv AI
Jun 18

A Distributionally Robust Reinforcement Learning Framework for Constrained Urban EV Dispatch

arXiv:2604. 25848v2 Announce Type: replace Abstract: We study city-scale control of electric-vehicle (EV) ride-hailing fleets where dispatch, repositioning, and charging decisions must respect charger and feeder limits under uncertain, spatially correlated demand and travel times.

By An Nguyen, Hoang Nguyen, Phuong Le, Hung Pham, Cuong Do, Laurent El Ghaoui
arXiv AI
Aug 28

AI agents in Algorithmic Electricity Markets: On the Emergence of Tacit Collusion

The paper examines whether autonomous learning-based agents in electricity markets can develop tacit collusion without explicit coordination. By modeling strategic bidding as a repeated game with imperfect public monitoring and employing multi-agent reinforcement learning, the authors identify conditions under which agents achieve supra-competitive outcomes. Their experiments demonstrate that such collusive behavior can emerge naturally, highlighting a realistic risk for algorithmic electricity markets.

By Jakub Seredy\'nski, Georgios Tsaousoglou