arXiv Machine Learning

Flow-aware Optimal Navigation in Unsteady Flows through Reinforcement Learning

arXiv:2607. 13553v1 Announce Type: cross Abstract: Autonomous robotic navigation in nonstationary time-varying fluid flows remains a fundamental challenge due to partial observability and the unpredictability of realistic environments.

arXiv AI
Jul 1

The HydroGym Reinforcement Learning Platform for Fluid Dynamics

arXiv:2512. 17534v2 Announce Type: replace-cross Abstract: Modeling and controlling fluids is critical across science and engineering.

By Christian Lagemann, Sajeda Mokbel, Miro Gondrum, Mario R\"uttgers, Yuning Wang, Pol Su\'arez, Ludger Paehler, Deniz A. Bezgin, Aaron B. Buhendwa, Jared L. Callaham, Samuel Ahnert, Nicholas Zolman, Xiao Shao, Jean-Christophe Loiseau, Nikolaus Adams, Matthias Meinke, Wolfgang Schr\"oder, Kai Lagemann, Esther Lagemann, Ricardo Vinuesa, Steven L. Brunton
arXiv Machine Learning
Jun 26

Reinforcement Learning Enables Autonomous Microrobot Navigation and Intervention in Simulated Blood Capillaries

arXiv:2606. 26154v1 Announce Type: cross Abstract: Autonomous microrobots navigating biological vasculature could enable targeted drug delivery and thrombolysis, yet training control policies for realistic environments remains an open challenge.

By Jannik Drotleff, Samuel Tovey, Paul Hohenberger, Christoph Lohrmann, Julian Ho{\ss}bach, Konstantin Nikolaou, Christian Holm
arXiv AI
Aug 26

Self-Evolving Scientific Agent Designs Physically-Reasoned Whitebox Fluid Control

The paper introduces a self‑evolving scientific agent that uses large language models and iterative code generation to build interpretable, physically‑reasoned white‑box controllers for complex systems. The agent deploys candidate controllers in simulations, diagnoses dynamic behavior from multimodal evidence, and refines source code until a robust policy is achieved. Applied to a nonlinear fluid‑structure interaction problem—a two‑joint dogfish swimmer navigating an unsteady wake—the agent autonomously designs a controller that consistently reaches targets across a wide range of conditions without retraining.

By Boai Sun, Wenjin Guo, Zongmin Yu, Liu Yang
arXiv AI
Jun 9

Self-Evolving Scientific Agent Discovers Generalizable Physically-Reasoned Fluid Control

arXiv:2606. 08405v1 Announce Type: new Abstract: While data-intensive deep reinforcement learning can optimize complex control policies, scientific discovery in physical systems fundamentally requires an interpretable chain of reasoning that connects physical evidence to structured control architectures.

By Boai Sun, Wenjin Guo, Zongmin Yu, Liu Yang
arXiv AI
Sep 11

Self-Evolving Scientific Agent Designs Physically Reasoned White-Box Fluid Control

The paper presents a method where self‑evolving scientific agents design explicit, neural‑network‑free white‑box controllers for fluid dynamics tasks. By iteratively interpreting simulation data, the agents accumulate control knowledge and refine controller code, ultimately achieving robust control of an underactuated two‑joint swimmer in unsteady flows. The resulting controllers generalize across varying target positions, wake geometries, cylinder counts, and inflow speeds, and 2D control priors successfully transfer to accelerate 3D adaptation.

By Boai Sun, Wenjin Guo, Zongmin Yu, Liu Yang