Timescale Separation Enables Deep Reinforcement Learning Control of Rotating Detonation Engine Mode Transitions
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The article discusses how glass-box deep reinforcement learning (DRL) can discover actuation strategies for high‑speed, nonlinear, unsteady flows without explicit models, potentially revealing mechanisms beyond classical control. It highlights the challenges of applying DRL to real high‑speed flows, including simulation cost, data efficiency, sensing in extreme environments, reward design, explainability, and generalization across Mach and Reynolds numbers. The authors argue that overcoming these constraints will require physics‑aware learning, robust real‑time operation, and extensive validation to translate DRL capabilities into reliable, certified technology.
arXiv:2607. 16177v1 Announce Type: new Abstract: Reinforcement learning (RL) has recently emerged as a promising feedback control strategy for nonlinear and complex dynamical systems.
arXiv:2512. 17534v2 Announce Type: replace-cross Abstract: Modeling and controlling fluids is critical across science and engineering.
arXiv:2607. 16313v1 Announce Type: new Abstract: Traditional controllers are designed for specific systems and do not transfer across different system orders and dynamics.
The paper proposes a hybrid PID–Deep Reinforcement Learning (DRL) controller for industrial processes, addressing the limitations of traditional PID controllers in complex, non‑linear, multi‑input environments. Using the Industrial Benchmark (IB) to test DRL, the authors develop a multi‑objective reward function and employ a TD3 agent to discover optimal settings for the IB’s ‘Gain’ and ‘Shift’ parameters. These parameters are then fed into a tuned PID controller, yielding a system that combines the optimal performance and efficiency of DRL with the reliability of classical control.
arXiv:2610.29075v1 Announce Type: new Abstract: We aim to address the problem of Out-of-Distribution (OOD) Mode Averaging, a critical problem that emerges when distilling Flow Matching (FM) based beh...