arXiv Machine Learning

Label-Free Finite-Volume-Residual Training of Attention Graph Neural Networks for Coupled Thermo-Fluid Fields

arXiv:2607. 20321v1 Announce Type: cross Abstract: Neural surrogates are widely used in scientific machine learning for fast prediction of three-dimensional (3D) thermo-fluid fields.

Hugging Face Trending Papers
Jul 13

A multi-scale feature enhanced graph neural network for fluid dynamics prediction in complex geometries

Industrial design in fields such as vehicle and aerospace engineering often relies on large-scale numerical simulations to evaluate fluid dynamics performance, which can incur substantial computational costs. Deep neural networks have shown promise in improving simulation efficiency, especially graph neural networks (GNNs), which demonstrate great potential due to their flexibility with unstructured data.

arXiv Machine Learning
Sep 7

Disentangling Attention in Deep Operator Learning: A Controlled Study of Data-Driven and Physics-Informed Architectures

The paper investigates how different attention mechanisms affect the performance of DeepONet neural operators. Five variants—varying in cross‑attention, self‑attention, tokenization, and attention depth—are trained in both data‑driven and physics‑informed settings on one‑ and two‑dimensional PDE benchmarks. Results show that per‑sensor tokenization with cross‑attention consistently reduces error, while branch self‑attention helps only in complex spatial problems, and deeper cross‑attention yields diminishing returns with higher cost.

By Amar Alem Koric, Qibang Liu, Seid Koric
arXiv AI
3d ago

Cluster Attention Neural Operators for Solving Parametric Partial Differential Equations

The paper introduces the Cluster Attention Neural Operator (CANO), a neural operator that uses a novel cross‑attention mechanism to dynamically cluster queries while keeping full‑resolution keys and values. This design eliminates the slice compression and weight‑sharing limitations of previous Transformer‑based operators, maintaining fast computation and global interactions. Experiments on a range of fluid and solid dynamics benchmarks—including Navier‑Stokes, Airfoil, Plasticity, Pipe Turbulence, and Composites—show that CANO achieves lower errors than existing baselines and demonstrates strong geometric adaptability and temporal consistency.

By Ming Zhong, Antonio Colanera, Gianluigi Rozza, Zhenya Yan
Hugging Face Trending Papers
Sep 17

Amortizing Physics-Informed Neural Solvers via Graph Hypernetworks

The paper proposes a method to amortize physics-informed neural networks (PINNs) across related partial differential equations (PDEs) by explicitly modeling equation relationships in an operator graph. Coefficient vectors encode numerical parameters, while the graph hypernetwork generates diagonal codes that initialize a meta‑trained factorized PINN for each target equation. Experiments on scalar convection‑diffusion‑reaction, two‑field Fisher‑KPP, and a capacitively coupled plasma model show that term‑based descriptors and graph conditioning improve solution accuracy compared to coefficient‑vector conditioning alone.

arXiv Machine Learning
Jun 25

Surrogate models for Rock-Fluid Interaction: A Grid-Size-Invariant Approach

arXiv:2602. 22188v2 Announce Type: replace Abstract: Modelling rock-fluid interaction requires solving a set of partial differential equations (PDEs) to predict the flow behaviour and the reactions of the fluid with the rock on the interfaces.

By Nathalie C. Pinheiro, Donghu Guo, Hannah P. Menke, Aniket C. Joshi, Claire E. Heaney, Ahmed H. ElSheikh, Christopher C. Pain