arXiv Machine Learning

Spatiotemporal Graph Transformer for 3D Neighborhood Interaction and Quality Prediction in Metal Additive Manufacturing

arXiv:2606. 10227v1 Announce Type: new Abstract: Metal additive manufacturing enables the fabrication of complex parts, but achieving consistent build quality remains challenging due to interactions induced by repeated layer-wise melting, solidification, and reheating across the 3D build.

arXiv Machine Learning
Sep 29

MeshGraphNet-Transformer: Scalable Mesh-based Learned Simulation for Solid Mechanics

MeshGraphNet-Transformer (MGN‑T) is a new architecture that fuses Transformers’ global modeling with MeshGraphNets’ geometric inductive bias, keeping a mesh‑based graph representation. It replaces iterative message passing with a physics‑attention Transformer that updates all nodal states simultaneously, enabling efficient learning on high‑resolution meshes with diverse geometries, topologies, and boundary conditions. MGN‑T accurately models impact dynamics, self‑contact, plasticity, and multivariate outputs, outperforming state‑of‑the‑art methods on classical benchmarks while using far fewer parameters.

By Mikel M. Iparraguirre, Iciar Alfaro, David Gonzalez, Elias Cueto
arXiv AI
Jul 28

A Survey of Graph Transformers: Architectures, Theories and Applications

arXiv:2502. 16533v3 Announce Type: replace-cross Abstract: Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-smoothing and over-squashing.

By Chaohao Yuan, Kangfei Zhao, Ercan Engin Kuruoglu, Liang Wang, Tingyang Xu, Wenbing Huang, Deli Zhao, Hong Cheng, Yu Rong
arXiv AI
Sep 7

Dynamic Heterogeneous Graph Representation Learning: A Survey

The article surveys Dynamic Heterogeneous Graph Representation Learning (DHGRL), a field that tackles the challenges of modeling evolving, multi‑type networks. It introduces a unified definition covering both discrete‑time and continuous‑time DHGs, and proposes an algorithm‑centric taxonomy that groups methods into embedding‑based, GNN‑based, and Transformer‑based approaches, highlighting their biases toward temporal granularity. The survey also reviews key applications, datasets, benchmarks, and outlines future research directions.

By Huan Liu, Pengfei Jiao, Jie Yin, Hongjiang Chen, Zhidong Zhao
arXiv Machine Learning
Jun 3

TIDFormer: Exploiting Temporal and Interactive Dynamics Makes A Great Dynamic Graph Transformer

arXiv:2506. 00431v2 Announce Type: replace Abstract: Due to the proficiency of self-attention mechanisms (SAMs) in capturing dependencies in sequence modeling, several existing dynamic graph neural networks (DGNNs) utilize Transformer architectures with various encoding designs to capture sequential evolutions of dynamic graphs.

By Jie Peng, Zhewei Wei, Yuhang Ye