The HydroGym Reinforcement Learning Platform for Fluid Dynamics
arXiv:2512. 17534v2 Announce Type: replace-cross Abstract: Modeling and controlling fluids is critical across science and engineering.
arXiv:2607. 13553v1 Announce Type: cross Abstract: Autonomous robotic navigation in nonstationary time-varying fluid flows remains a fundamental challenge due to partial observability and the unpredictability of realistic environments.
arXiv:2512. 17534v2 Announce Type: replace-cross Abstract: Modeling and controlling fluids is critical across science and engineering.
arXiv:2606. 31025v1 Announce Type: new Abstract: Active flow control is a fundamental application in engineering.
arXiv:2606. 26154v1 Announce Type: cross Abstract: Autonomous microrobots navigating biological vasculature could enable targeted drug delivery and thrombolysis, yet training control policies for realistic environments remains an open challenge.
arXiv:2609.14261v1 Announce Type: cross Abstract: Recent robot learning paradigms increasingly rely on large offline datasets of robotic interactions to train control policies. Expressive generative...
arXiv:2606. 08513v1 Announce Type: cross Abstract: Autonomous Underwater Vehicles (AUVs) traditionally rely on complex, heavily engineered pipelines for perception, path planning, and motion control.
The paper introduces a self‑evolving scientific agent that uses large language models and iterative code generation to build interpretable, physically‑reasoned white‑box controllers for complex systems. The agent deploys candidate controllers in simulations, diagnoses dynamic behavior from multimodal evidence, and refines source code until a robust policy is achieved. Applied to a nonlinear fluid‑structure interaction problem—a two‑joint dogfish swimmer navigating an unsteady wake—the agent autonomously designs a controller that consistently reaches targets across a wide range of conditions without retraining.
arXiv:2606. 08405v1 Announce Type: new Abstract: While data-intensive deep reinforcement learning can optimize complex control policies, scientific discovery in physical systems fundamentally requires an interpretable chain of reasoning that connects physical evidence to structured control architectures.
The paper presents a method where self‑evolving scientific agents design explicit, neural‑network‑free white‑box controllers for fluid dynamics tasks. By iteratively interpreting simulation data, the agents accumulate control knowledge and refine controller code, ultimately achieving robust control of an underactuated two‑joint swimmer in unsteady flows. The resulting controllers generalize across varying target positions, wake geometries, cylinder counts, and inflow speeds, and 2D control priors successfully transfer to accelerate 3D adaptation.
arXiv:2607. 16177v1 Announce Type: new Abstract: Reinforcement learning (RL) has recently emerged as a promising feedback control strategy for nonlinear and complex dynamical systems.
arXiv:2607. 11565v1 Announce Type: cross Abstract: Active flow control involves nonlinear dynamics, partial observations, and computationally expensive simulations, making controller design particularly challenging.
arXiv:2607. 14272v1 Announce Type: new Abstract: Flow matching has emerged as an effective framework for learning complex data distributions, but adapting pretrained flow models to new tasks often requires computationally expensive retraining.
arXiv:2606. 11274v1 Announce Type: cross Abstract: Rendezvous is a critical task for multi-agent systems, requiring agents to coordinate to meet at an unspecified location.