arXiv Machine Learning
2d ago

Glass-Box Deep Reinforcement Learning for High-Speed Flow Control

The article discusses how glass-box deep reinforcement learning (DRL) can discover actuation strategies for high‑speed, nonlinear, unsteady flows without explicit models, potentially revealing mechanisms beyond classical control. It highlights the challenges of applying DRL to real high‑speed flows, including simulation cost, data efficiency, sensing in extreme environments, reward design, explainability, and generalization across Mach and Reynolds numbers. The authors argue that overcoming these constraints will require physics‑aware learning, robust real‑time operation, and extensive validation to translate DRL capabilities into reliable, certified technology.

By Ameya D. Jagtap
arXiv AI
Jul 1

The HydroGym Reinforcement Learning Platform for Fluid Dynamics

arXiv:2512. 17534v2 Announce Type: replace-cross Abstract: Modeling and controlling fluids is critical across science and engineering.

By Christian Lagemann, Sajeda Mokbel, Miro Gondrum, Mario R\"uttgers, Yuning Wang, Pol Su\'arez, Ludger Paehler, Deniz A. Bezgin, Aaron B. Buhendwa, Jared L. Callaham, Samuel Ahnert, Nicholas Zolman, Xiao Shao, Jean-Christophe Loiseau, Nikolaus Adams, Matthias Meinke, Wolfgang Schr\"oder, Kai Lagemann, Esther Lagemann, Ricardo Vinuesa, Steven L. Brunton
arXiv Machine Learning
Sep 22

Augmenting PID Control with Deep Reinforcement Learning: A Hybrid Approach to the Industrial Benchmark

The paper proposes a hybrid PID–Deep Reinforcement Learning (DRL) controller for industrial processes, addressing the limitations of traditional PID controllers in complex, non‑linear, multi‑input environments. Using the Industrial Benchmark (IB) to test DRL, the authors develop a multi‑objective reward function and employ a TD3 agent to discover optimal settings for the IB’s ‘Gain’ and ‘Shift’ parameters. These parameters are then fed into a tuned PID controller, yielding a system that combines the optimal performance and efficiency of DRL with the reliability of classical control.

By Zhengyang (Cissy), Gu, Joseph E. Hernandez, John Burtenshaw, Sean Scott, Thomas Cook, Chris Couch