arXiv Machine Learning July 15, 2026 By Giorgio Maria Cavallazzi, Miguel P\'erez Cuadrado, Alfredo Pinelli

Gradient-free learning of a closed-loop wall controller for turbulent drag reduction

Read the original on arXiv Machine Learning →

arXiv:2607. 12626v1 Announce Type: cross Abstract: Closed-loop wall control learnt by multi-agent reinforcement learning can lower skin-friction drag in turbulent channels, but these gradient-based policies are trained on small periodic boxes and exhibit reduced performance when carried over to a larger domain.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers

Jul 14

Gradient-free learning of a closed-loop wall controller for turbulent drag reduction

Closed-loop wall control learnt by multi-agent reinforcement learning can lower skin-friction drag in turbulent channels, but these gradient-based policies are trained on small periodic boxes and exhibit reduced performance when carried over to a larger domain. We recently showed that such policies are also prone to saturated bang-bang actuations that collapse into standing streamwise waves whose scale is set by the computational box rather than by the near-wall cycle, and proposed architectural fixes that avoid these degeneracies.

agents reinforcement-learning

arXiv AI

Jun 2

Explainable deep reinforcement learning reveals energy-efficient control strategies for turbulent drag reduction

arXiv:2606. 00949v1 Announce Type: cross Abstract: We propose a method combining Multi-Agent Deep Reinforcement Learning (MARL) and eXplainable Deep Learning (XDL) to reduce drag in wall-bounded turbulent flows.

By Federica Tonti, Ricardo Vinuesa

agents reinforcement-learning

arXiv Machine Learning

Jun 17

Reward hacking in physical reinforcement learning revealed by turbulent drag reduction

arXiv:2606. 06227v2 Announce Type: replace-cross Abstract: A reinforcement-learning agent maximises its reward, which can diverge from the outcome its designer intended.

By Giorgio Maria Cavallazzi, Miguel P\'erez-Cuadrado, Alfredo Pinelli

agents reinforcement-learning

arXiv Machine Learning

Jun 5

Drag reduction or reward hacking? Recurrent multi-agent reinforcement learning that earns its reward

arXiv:2606. 06227v1 Announce Type: cross Abstract: A reinforcement-learning agent maximises its reward, which can diverge from the outcome its designer intended.

By Giorgio Maria Cavallazzi, Miguel P\'erez-Cuadrado, Alfredo Pinelli

agents reinforcement-learning

arXiv Machine Learning

Jul 3

Wind-Aware Reinforcement Learning Control of a Small Quadrotor Using Learned Onboard Wind Estimation in Simulated Atmospheric Turbulence

arXiv:2607. 01528v1 Announce Type: new Abstract: Small multirotor aircraft are increasingly tasked with operations in the atmospheric boundary layer, where turbulent winds comparable to the vehicle's airspeed degrade trajectory tracking and can defeat conventional feedback control.

By Abdullah Al Tasim, Wei Sun

reinforcement-learning benchmarks

arXiv AI

Jul 1

The HydroGym Reinforcement Learning Platform for Fluid Dynamics

arXiv:2512. 17534v2 Announce Type: replace-cross Abstract: Modeling and controlling fluids is critical across science and engineering.

By Christian Lagemann, Sajeda Mokbel, Miro Gondrum, Mario R\"uttgers, Yuning Wang, Pol Su\'arez, Ludger Paehler, Deniz A. Bezgin, Aaron B. Buhendwa, Jared L. Callaham, Samuel Ahnert, Nicholas Zolman, Xiao Shao, Jean-Christophe Loiseau, Nikolaus Adams, Matthias Meinke, Wolfgang Schr\"oder, Kai Lagemann, Esther Lagemann, Ricardo Vinuesa, Steven L. Brunton

agents reinforcement-learning robotics benchmarks

Related stories

Gradient-free learning of a closed-loop wall controller for turbulent drag reduction

Explainable deep reinforcement learning reveals energy-efficient control strategies for turbulent drag reduction

Reward hacking in physical reinforcement learning revealed by turbulent drag reduction

Drag reduction or reward hacking? Recurrent multi-agent reinforcement learning that earns its reward

Wind-Aware Reinforcement Learning Control of a Small Quadrotor Using Learned Onboard Wind Estimation in Simulated Atmospheric Turbulence

The HydroGym Reinforcement Learning Platform for Fluid Dynamics