arXiv Machine Learning July 28, 2026 By Guoze Sun, Rui Zhang, Jiankai Tang, Mengtao Yan, Runze Mao, Zhi X. Chen, Hao Sun

Physics Transformer: Tailoring Transformer for General PDE Prediction

Read the original on arXiv Machine Learning →

arXiv:2607. 24513v1 Announce Type: new Abstract: Transformer architectures have attracted increasing attention for solving partial differential equations (PDEs), owing to their flexibility in handling irregular discretizations and their ability to capture long-range physical dependencies.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 30

Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometries

arXiv:2602. 04940v2 Announce Type: replace Abstract: Deep learning has emerged as a transformative tool for the neural surrogate modeling of partial differential equations (PDEs), known as neural PDE solvers.

By Hang Zhou, Haixu Wu, Haonan Shangguan, Yuezhou Ma, Huikun Weng, Jianmin Wang, Mingsheng Long

llms benchmarks

arXiv Machine Learning

Jun 2

Flowers: A Warp Drive for Neural PDE Solvers

arXiv:2603. 04430v2 Announce Type: replace Abstract: We introduce Flowers, a neural architecture for learning PDE solution operators built entirely from multihead warps.

By Till Muser, Alexandra Spitzer, Matti Lassas, Maarten V. de Hoop, Ivan Dokmani\'c

llms benchmarks

arXiv AI

Jun 2

Towards a Physics Foundation Model

arXiv:2509. 13805v4 Announce Type: replace-cross Abstract: Foundation models have revolutionized natural language processing through a ``train once, deploy anywhere'' paradigm, where a single pre-trained model adapts to countless downstream tasks without retraining.

By Florian Wiesner, Zo\"e J. Gray, Matthias Wessling, Stephen Baek

llms nlp

arXiv Machine Learning

Jun 4

MeshTok: Efficient Multi-Scale Tokenization for Scalable PDE Transformers

arXiv:2606. 04366v1 Announce Type: new Abstract: Conventional patchified Transformers operate on uniform spatial partitions, distributing computational effort evenly across the domain irrespective of local features.

By Yanshun Zhao, Xiaoyu Peng, Jiamin Jiang, Congcong Zhu, Jingrun Chen

llms nlp benchmarks safety

arXiv Machine Learning

Jul 8

PGOT: A Physics-Geometry Operator Transformer for Complex PDEs

arXiv:2512. 23192v4 Announce Type: replace Abstract: While Transformers have demonstrated remarkable potential in modeling Partial Differential Equations (PDEs), modeling large-scale unstructured meshes with complex geometries remains a significant challenge.

By Zhuo Zhang, Xi Yang, Ying Miao, Xiaobin Hu, Yifu Gao, Yong Yang, Canqun Yang, Boocheong Khoo

llms benchmarks

arXiv AI

2d ago

ArGEnT: Arbitrary Geometry-encoded Transformer for Operator Learning

arXiv:2602. 11626v3 Announce Type: replace-cross Abstract: Learning solution operators on arbitrary geometries remains a central challenge in scientific machine learning, especially for many-query simulation, physics-informed learning, and evolving geometries requiring accurate, geometry-aware predictions at arbitrary spatial locations.

By Wenqian Chen, Zhi-Feng Wei, Yucheng Fu, Michael Penwarden, Pratanu Roy, Panos Stinis

llms benchmarks

Related stories

Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometries

Flowers: A Warp Drive for Neural PDE Solvers

Towards a Physics Foundation Model

MeshTok: Efficient Multi-Scale Tokenization for Scalable PDE Transformers

PGOT: A Physics-Geometry Operator Transformer for Complex PDEs

ArGEnT: Arbitrary Geometry-encoded Transformer for Operator Learning