arXiv Machine Learning By Keith G. Mills, Aedan J. DeFrates, Joong Ho Kim

How Much Does Message Passing Matter? A Drop-In Study of GNN Layers for Neural Network Graph Regression

Read the original on arXiv Machine Learning →

The study investigates how different message‑passing (MP) layers affect graph‑level regression performance in Graph Neural Networks (GNNs). By replacing the MP component in four existing GNN regressors with ten varied configurations—including convolutional, isomorphism‑based, and attention‑based designs—the authors evaluate performance across eleven neural‑network graph datasets, measuring metrics such as rank correlation, prediction error, top‑k retrieval, latency, and memory usage. Results show that the choice of MP layer significantly influences outcomes, with the optimal layer depending on graph size, training‑set size, and regression objective; classical layers like GEN, k‑GNN, and PNA outperform attention‑based layers on small graphs, while GATv2 excels on datasets with few large graphs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 19

Asynchronous Message Passing for Addressing Oversquashing in Graph Neural Networks

The paper introduces an asynchronous message‑passing framework for Graph Neural Networks to mitigate oversquashing, a problem where distant nodes cannot effectively communicate due to structural bottlenecks. Unlike conventional synchronous updates, the method updates a centrality‑guided batch of nodes at each layer, allowing information to propagate sequentially and reducing the need for increased channel capacity. Experiments on six standard and two long‑range graph classification benchmarks show notable performance gains, including 5 % improvement on REDDIT‑BINARY and 4 % on Peptides‑struct.

By Kushal Bose, Swagatam Das
arXiv AI
Jun 3

Learn When and Where to Connect: Adaptive Virtual Nodes for Dynamic Message Passing on Graphs

arXiv:2606. 03068v1 Announce Type: cross Abstract: While Virtual Nodes (VNs) are often utilized in Message Passing Neural Networks (MPNNs) to facilitate effective message passing, existing VN-based methods have limitations, such as constraining all nodes to connect to the same number of VNs, fixing the connections before applying MPNNs, and connecting a node to a VN independently of the other nodes that connect to the same VN.

By Jaejun Lee, Joyce Jiyoung Whang