arXiv AI

Learnable Splines for Unstructured Neural Operators

The paper introduces L‑SplineFNO, a memory‑efficient neural operator that combines a Fourier neural operator backbone with a learnable tensor‑product B‑spline transfer to map unstructured meshes to a latent Cartesian grid. By using a local normalised scatter, the method preserves spline properties without geometry‑dependent solves, enabling efficient training on up to 26.6 million nodes and inference on 46 million nodes on a single A100 GPU. L‑SplineFNO achieves strong predictive accuracy across six 3D engineering benchmarks, supports zero‑shot super‑resolution, efficient closed‑form spatial derivatives, and provides rigorous prediction bounds via Bernstein convex hulls and Taylor models on a large tokamak model.

arXiv AI
Sep 30

CAD-Native Transformer Operators for AI-Aided Engineering

arXiv:2609.36806v1 Announce Type: new Abstract: Modern engineering systems, from automobiles to aircraft, are designed by using precise, continuous parametric computer-aided design (CAD) models. Eval...

By Daniel Leibovici, Nikola Borislavov Kovachki, Dawon Ahn, Ruben Ohana, Ira J. S. Shokar, Abouzar Ghasemi, Semih Akkurt, Rishikesh Ranade, Neil Ashton, Jan Kautz, Jean Kossaifi
arXiv Machine Learning
Sep 30

Learning Spectrally Optimised Mesh-Free Discretisations

The paper introduces Spectrally Optimised Neural Discretisations (SpeND), a mesh‑free framework that learns discretisation weights from local stencil geometry on unstructured point clouds. By embedding discrete moment conditions into the network architecture, SpeND guarantees polynomial consistency and allows the weights to be optimised for spectral accuracy over a chosen wavenumber band, using an unsupervised Fourier‑mode loss. The resulting operators are PDE‑agnostic, perform well on Poisson, Burgers, and Navier–Stokes equations, and can reduce wall‑clock time by 3–20× compared to existing mesh‑free methods at the same accuracy.

By Lucas Gerken Starepravo, Henry Broadley, Steven Lind, Jack R. C. King
arXiv AI
Oct 2

CANTO: CAD-Native Transformer Operators for AI-Aided Engineering

CANTO is a transformer neural operator that directly maps continuous CAD geometry—represented as sequences of NURBS patches—to physical fields without requiring meshing. It tokenizes control points, knot vectors, and weights to predict continuous surface and volume fields at arbitrary query locations. Evaluated on automotive and aircraft aerodynamics benchmarks, CANTO achieves state‑of‑the‑art accuracy, notably a 19.8% reduction in surface‑pressure error on HiLiftAeroML, and enables gradient‑based inverse design, finding lower‑drag designs on AhmedML.

By Daniel Leibovici, Nikola Borislavov Kovachki, Dawon Ahn, Ruben Ohana, Ira J. S. Shokar, Abouzar Ghasemi, Semih Akkurt, Rishikesh Ranade, Neil Ashton, Jan Kautz, Jean Kossaifi
arXiv Machine Learning
Jul 10

PGD-NO: A Neural Operator with Precomputed Geometry Decomposition for 3D Million-scale Physics Simulations

arXiv:2607. 08025v1 Announce Type: new Abstract: While neural PDE solvers have demonstrated significant potential for accelerating engineering simulations, existing architectures remain constrained by high memory consumption and the single node bottleneck, where the maximum processable mesh resolution is strictly limited by the VRAM of a single compute unit.

By Weiheng Zhong, Jing Bi, Victor Oancea, Hadi Meidani
arXiv Machine Learning
Sep 24

MENO: Memory-Efficient Neural Operator

The paper introduces MENO, a Memory‑Efficient Neural Operator designed for solving partial differential equations (PDEs). MENO leverages a Manifold Function Encoder to achieve a small memory footprint that does not depend on data resolution, enabling faster training and potential scalability to large models. It accepts PDE inputs of arbitrary form—including different geometric domains and discretizations—allowing cross‑geometry scenarios, and demonstrates strong generalization with superior accuracy on most tested benchmarks.

By Shengyang Xu, Weijun Zhang, Jun Hu, Pengzhan Jin
arXiv Machine Learning
Oct 8

Fourier Feature Pyramids for Physics-Informed Neural Networks

The paper introduces beignet, a neural field architecture that replaces the random Fourier feature embedding in physics-informed neural networks with a trainable multi‑resolution Fourier feature pyramid. By using Fourier interpolation and spectral derivatives, beignet efficiently computes spatial derivatives and scales accuracy through the feature pyramid rather than the neural network size. Experiments show that beignet achieves more accurate PDE solutions with fewer parameters than existing PINN methods and can reach machine‑precision residuals on the inviscid Burgers blowup problem using the Adam optimizer.

By Brandon Zhao, Yixuan Wang, Jonathan T. Barron, Katherine L. Bouman, Dor Verbin, Pratul P. Srinivasan