arXiv Machine Learning June 2, 2026 By Bo Li, Chen Zhang

Quantifying the Energy Floor: Direct Measurement and Replay Buffer Bias in SAC-Based HVAC Control on sbsim

Read the original on arXiv Machine Learning →

arXiv:2606. 01665v1 Announce Type: new Abstract: We quantify the energy floor -- the minimum achievable cost given action space constraints -- for Soft Actor-Critic (SAC) HVAC control on the sbsim calibrated building simulator.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 15

Verifier-Based Reinforcement Fine-Tuning of Reasoning Models for Thermal Energy Storage Control

arXiv:2607. 12856v1 Announce Type: new Abstract: Buildings are expected to shift cooling loads in response to grid conditions.

By Takumi Shioda, Kohei Terashima, Tatsuo Nagai

llms reinforcement-learning fine-tuning benchmarks

arXiv Machine Learning

Jul 20

Comparative Field Deployment of Reinforcement Learning and Model Predictive Control for Residential HVAC

arXiv:2510. 01475v2 Announce Type: replace-cross Abstract: Model Predictive Control (MPC) has demonstrated significant performance improvements over today's control methods for residential Heating, Ventilation, and Air Conditioning (HVAC), but deploying MPC often requires substantial engineering effort.

By Ozan Baris Mulayim, Elias N. Pergantis, Levi D. Reyes Premer, Bingqing Chen, Guannan Qu, Kevin J. Kircher, Mario Berg\'es

reinforcement-learning

arXiv AI

Aug 11

Learning to Modulate, Not to Cycle: Soft Actor---Critic Recovers Inverter-Style Heat-Pump Control

arXiv:2608. 09453v1 Announce Type: cross Abstract: On--off cycling is the main cause of compressor wear in residential heat pumps, yet reinforcement learning (RL) controllers for buildings typically optimise only energy cost and thermal comfort, ignoring how much the learned policy cycles.

By Faizan Ahmed, Aniket Dixit, James Brusey

reinforcement-learning

arXiv Machine Learning

Jul 31

Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Control

arXiv:2607. 27914v1 Announce Type: new Abstract: Multi-zone variable-air-volume control must balance thermal comfort, indoor air quality, and electricity use across several continuous actuators.

By Takumi Shioda, Kohei Terashima, Tatsuo Nagai

llms reinforcement-learning fine-tuning

arXiv AI

Aug 6

Strategic Evaluation of Planning Strategies for LLM Agents in Cyber-Physical Systems

arXiv:2608. 04265v1 Announce Type: cross Abstract: Evaluations of LLM planning agents largely ask whether a task succeeds or a declared plan is followed.

By J. de Curt\`o, I. de Zarz\`a

llms agents benchmarks

arXiv Machine Learning

Jun 30

Toward an Energy-Optimized Operation of Data Centers Located in Wind Farms Using Reinforcement Learning

arXiv:2606. 30316v1 Announce Type: new Abstract: This paper studies Reinforcement Learning as an online controller for curtailment-aware workload shifting in wind-turbine-integrated high-performance computing (HPC) data centers.

By Jan Stenner, Alexander Kilian, Sebastian Peitz, Hermann de Meer

reinforcement-learning benchmarks

Related stories

Verifier-Based Reinforcement Fine-Tuning of Reasoning Models for Thermal Energy Storage Control

Comparative Field Deployment of Reinforcement Learning and Model Predictive Control for Residential HVAC

Learning to Modulate, Not to Cycle: Soft Actor---Critic Recovers Inverter-Style Heat-Pump Control

Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Control

Strategic Evaluation of Planning Strategies for LLM Agents in Cyber-Physical Systems

Toward an Energy-Optimized Operation of Data Centers Located in Wind Farms Using Reinforcement Learning