arXiv Machine Learning July 28, 2026 By Guoze Sun, Rui Zhang, Jiankai Tang, Mengtao Yan, Runze Mao, Zhi X. Chen, Hao Sun

Physics Transformer: Tailoring Transformer for General PDE Prediction

Read the original on arXiv Machine Learning →

arXiv:2607. 24513v1 Announce Type: new Abstract: Transformer architectures have attracted increasing attention for solving partial differential equations (PDEs), owing to their flexibility in handling irregular discretizations and their ability to capture long-range physical dependencies.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 30

Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometries

arXiv:2602. 04940v2 Announce Type: replace Abstract: Deep learning has emerged as a transformative tool for the neural surrogate modeling of partial differential equations (PDEs), known as neural PDE solvers.

By Hang Zhou, Haixu Wu, Haonan Shangguan, Yuezhou Ma, Huikun Weng, Jianmin Wang, Mingsheng Long

llms benchmarks

arXiv Machine Learning

Aug 26

Physics-Integrated Operator Learning via Gaussian Splatting Representations

arXiv:2608.24049v1 Announce Type: new Abstract: Neural operators provide efficient surrogates for spatiotemporal PDE systems, but purely data-driven formulations often accumulate substantial errors d...

By Jihao Zhang, Junyi Guo, Jian-Xun Wang

diffusion benchmarks

arXiv Machine Learning

Jun 2

Flowers: A Warp Drive for Neural PDE Solvers

arXiv:2603. 04430v2 Announce Type: replace Abstract: We introduce Flowers, a neural architecture for learning PDE solution operators built entirely from multihead warps.

By Till Muser, Alexandra Spitzer, Matti Lassas, Maarten V. de Hoop, Ivan Dokmani\'c

llms benchmarks

arXiv AI

Jun 2

Towards a Physics Foundation Model

arXiv:2509. 13805v4 Announce Type: replace-cross Abstract: Foundation models have revolutionized natural language processing through a ``train once, deploy anywhere'' paradigm, where a single pre-trained model adapts to countless downstream tasks without retraining.

By Florian Wiesner, Zo\"e J. Gray, Matthias Wessling, Stephen Baek

llms nlp

arXiv Machine Learning

Jun 4

MeshTok: Efficient Multi-Scale Tokenization for Scalable PDE Transformers

arXiv:2606. 04366v1 Announce Type: new Abstract: Conventional patchified Transformers operate on uniform spatial partitions, distributing computational effort evenly across the domain irrespective of local features.

By Yanshun Zhao, Xiaoyu Peng, Jiamin Jiang, Congcong Zhu, Jingrun Chen

llms nlp benchmarks safety

arXiv Machine Learning

Jul 8

PGOT: A Physics-Geometry Operator Transformer for Complex PDEs

arXiv:2512. 23192v4 Announce Type: replace Abstract: While Transformers have demonstrated remarkable potential in modeling Partial Differential Equations (PDEs), modeling large-scale unstructured meshes with complex geometries remains a significant challenge.

By Zhuo Zhang, Xi Yang, Ying Miao, Xiaobin Hu, Yifu Gao, Yong Yang, Canqun Yang, Boocheong Khoo

llms benchmarks

One email a morning, machine-written

Related stories

Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometries

Physics-Integrated Operator Learning via Gaussian Splatting Representations

Flowers: A Warp Drive for Neural PDE Solvers

Towards a Physics Foundation Model

MeshTok: Efficient Multi-Scale Tokenization for Scalable PDE Transformers

PGOT: A Physics-Geometry Operator Transformer for Complex PDEs