arXiv Machine Learning

Oscillatory Neural Dynamics over Sheaves

The paper introduces ONDA, a graph learning framework that uses operator‑valued information waves to enable effective long‑range propagation in graph neural networks. ONDA evolves stalk‑valued representations through second‑order dynamics governed by learned sheaf transport operators, combining wave‑like propagation with expressive local geometry. Experiments on challenging benchmarks show that ONDA consistently outperforms scalar wave propagation, diffusive sheaf baselines, and state‑of‑the‑art models, demonstrating the advantage of coupling wave dynamics with matrix‑valued transport.

arXiv Machine Learning
Jun 2

Graph Navier Stokes Networks

arXiv:2605. 21247v3 Announce Type: replace Abstract: Graph Neural Networks (GNNs) have emerged as a cornerstone of deep learning, with most existing methods rooted in graph signal processing and diffusion equations to model message passing.

By Zexing Zhao, Guangsi Shi, Yu Gong, Tianyu Wang, Shirui Pan, Hongye Cheng, Yuxiao Li
arXiv Machine Learning
Oct 3

Information propagation dynamics in Deep Graph Networks

The paper explores how information propagates in Deep Graph Networks (DGNs) for both static and dynamic graphs, treating DGNs as dynamical systems. It presents new architectures that better preserve long‑term node dependencies and learn complex spatio‑temporal patterns from irregular, sparsely sampled dynamic graphs. The work combines theoretical analysis with empirical results to demonstrate the effectiveness of these designs.

By Alessio Gravina
arXiv Machine Learning
Jun 2

Sheaf Neural Networks on SPD Manifolds: Second-Order Geometric Representation Learning

arXiv:2604. 20308v2 Announce Type: replace Abstract: Graph neural networks face two fundamental challenges rooted in the linear structure of Euclidean vector spaces: (1) Current architectures represent geometry through vectors (directions, gradients), yet many tasks require matrix-valued representations that capture relationships between directions-such as how atomic orientations covary in a molecule.

By Yuhan Peng, Junwen Dong, Yuzhi Zeng, Hao Li, Ce Ju, Huitao Feng, Diaaeldin Taha, Anna Wienhard, Kelin Xia
arXiv Machine Learning
5d ago

Deep Neural Sheaf Diffusion

Deep Neural Sheaf Diffusion (DNSD) is a new graph neural network architecture that replaces the sheaf Laplacian with a sheaf adjacency operator to keep informative signals across many layers. It also uses normalization, odd nonlinearities, and gating, and replaces scalar attention with matrix-valued edge functions. Experiments show DNSD outperforms existing GNNs and Neural Sheaf Diffusion on both synthetic long‑range and real‑world graph benchmarks, achieving up to 30 percentage‑point gains in accuracy.

By R\'emi Bourgerie, \v{S}ar\=unas Girdzijauskas, Viktoria Fodor
arXiv Machine Learning
Oct 23

Graph-Recurrent Learning of Emergent Collective Dynamics

The paper introduces a graph-recurrent neural network (GRNN) that learns emergent collective dynamics directly from trajectory data, without requiring explicit microscopic equations of motion. The GRNN combines gated recurrent memory with graph message passing, allowing local hidden states to capture information beyond instantaneous observables and to propagate spatially. The authors validate the approach on the semiclassical Holstein model, successfully reproducing temporal and spatial correlations and dynamical scaling during domain coarsening of charge-density-wave order.

By Ali Rayat, Acacia Lee, Gia-Wei Chern
arXiv Machine Learning
Aug 19

Asynchronous Message Passing for Addressing Oversquashing in Graph Neural Networks

The paper introduces an asynchronous message‑passing framework for Graph Neural Networks to mitigate oversquashing, a problem where distant nodes cannot effectively communicate due to structural bottlenecks. Unlike conventional synchronous updates, the method updates a centrality‑guided batch of nodes at each layer, allowing information to propagate sequentially and reducing the need for increased channel capacity. Experiments on six standard and two long‑range graph classification benchmarks show notable performance gains, including 5 % improvement on REDDIT‑BINARY and 4 % on Peptides‑struct.

By Kushal Bose, Swagatam Das