arXiv AI

Degraded but Not Entirely Ineffective: PE-Based Deformable Graph Neural Networks

The paper introduces a Position Encoding-Based Deformable Spatial Aggregation Module (PEBDSAM) that uses a deformable mechanism in position space to identify relevant nodes beyond first‑order neighbors, thereby addressing over‑smoothing, over‑compression, limited receptive fields, and noise from heterophilous graphs. Diagnostic experiments revealed that current offsets are ineffective, yet performance still improves, leading to a streamlined version called PEBSAM and a faster variant, PEBSAM‑Speed. The module is plug‑and‑play and can be integrated into GCN, GAT, GIN, and GraphSAGE, achieving strong results on both homophilous and heterophilous datasets.

arXiv Machine Learning
Oct 16

Size-Transferability of Graph Transformers with Convolutional Positional Encodings

The paper investigates Graph Transformers (GTs) that use Graph Neural Network (GNN)-based positional encodings. By analyzing GTs through manifold limit models, the authors establish a theoretical link between GTs and Manifold Neural Networks (MNNs), showing that GTs inherit transferability guarantees from their positional encodings. Experiments on standard graph benchmarks confirm that GTs scale comparably to GNNs, and a real‑world shortest‑path estimation task demonstrates their practical efficiency on large terrains.

By Javier Porras-Valenzuela, Zhiyang Wang, Teresa Shang, Yusu Wang, Alejandro Ribeiro
arXiv Machine Learning
Sep 22

SiST-GNN: Simultaneous Spatial-Temporal Message Passing for Dynamic Graph Representation Learning

SiST‑GNN introduces a simultaneous spatial‑temporal message‑passing framework for dynamic graph neural networks, fusing per‑node temporal embeddings with spatial aggregation in a single operation. By maintaining a recurrent hidden state per node and treating it as a cross‑time edge, the model jointly reasons over topology and evolution. Experiments on link‑prediction and node‑classification benchmarks show significant improvements over prior methods, achieving up to 158% gains in live‑update link prediction and outperforming discrete‑time baselines by 7–23% in dynamic node classification.

By Shubhajit Roy, Anirban Dasgupta
arXiv Machine Learning
Aug 27

DeltaGNN: Graph Neural Network with Information Flow Control

DeltaGNN introduces an information flow control mechanism that uses a new connectivity measure, the information flow score, to mitigate over‑smoothing and over‑squashing in Graph Neural Networks. This approach enables linear computational and memory overhead while effectively capturing both short‑range and long‑range node interactions. Experiments on ten diverse real‑world datasets demonstrate superior performance with limited computational complexity.

By Kevin Mancini, Islem Rekik
arXiv Machine Learning
Sep 7

Reservoir-Based Graph Convolutional Networks

The paper introduces RGC‑Net, a Reservoir‑Based Graph Convolutional Network that combines fixed‑random reservoir dynamics with a structured convolutional framework for graph learning. It addresses limitations of existing reservoir‑based GNNs by adding a leaky integrator for better feature retention and a robust, adaptable architecture for graph classification and generation. Experiments demonstrate state‑of‑the‑art performance on classification and generative tasks, including dynamic brain connectivity, with faster convergence and reduced over‑smoothing.

By Mayssa Soussia, Gita Ayu Salsabila, Mohamed Ali Mahjoub, Islem Rekik
arXiv Machine Learning
Jun 5

HOPSE: Scalable Higher-Order Positional and Structural Encoder for Combinatorial Representations

arXiv:2505. 15405v3 Announce Type: replace Abstract: While Graph Neural Networks (GNNs) have proven highly effective at modeling relational data, pairwise connections cannot fully capture multi-way relationships naturally present in complex real-world systems.

By Guillermo Bern\'ardez, Marco Montagna, Louis Van Langendonck, Martin Carrasco, Amirreza Akbari, Louisa Cornelis, Mathilde Papillon, Pere Barlet-Ros, Nina Miolane, Lev Telyatnikov
arXiv Machine Learning
Aug 19

HyPE-GT: where Graph Transformers meet Hyperbolic Positional Encodings

HyPE-GT introduces a framework that generates learnable hyperbolic positional encodings for Graph Transformers, enabling the capture of complex hierarchical relationships in graph-structured data. Unlike traditional Euclidean encodings, HyPE’s hyperbolic encodings can be selected to suit specific downstream tasks and help mitigate oversmoothing in deep Graph Neural Networks. Experiments on molecular benchmarks and large-scale Open Graph Benchmark datasets demonstrate improved performance, while additional tests on Coauthor and Copurchase networks confirm HyPE’s effectiveness in controlling oversmoothing.

By Kushal Bose, Swagatam Das
arXiv Machine Learning
Oct 15

Universal Sample-Based Embeddings of Higher-Order Objects

arXiv:2610.19899v1 Announce Type: new Abstract: Neural networks operate naturally on finite-dimensional vectors, yet many problems require reasoning about higher-order objects such as distributions,...

By Radovan Halu\v{s}ka, Christopher Solinas, Nathan R. Sturtevant, Martin Schmid, Michael Bowling