arXiv Machine Learning

Graph Additive Models disentangling feature, topology, and interactions

Graph Additive Models (AMIGA) address three key limitations of Graph Neural Additive Networks (GNANs): they prevent irrelevant nodes from inheriting spurious relevance, represent topology via mined motifs instead of only shortest‑path distances, and separate feature, structure, and interaction effects into distinct additive channels. AMIGA’s decomposition is centered around a graph‑balanced training baseline, ensuring a unique and well‑defined representation for each node. Across ten graph classification and regression benchmarks, AMIGA outperforms GNAN on most datasets and narrows the performance gap with standard black‑box GNNs, while providing node‑local explanations that exactly reconstruct the model output.

arXiv Machine Learning
Aug 27

DeltaGNN: Graph Neural Network with Information Flow Control

DeltaGNN introduces an information flow control mechanism that uses a new connectivity measure, the information flow score, to mitigate over‑smoothing and over‑squashing in Graph Neural Networks. This approach enables linear computational and memory overhead while effectively capturing both short‑range and long‑range node interactions. Experiments on ten diverse real‑world datasets demonstrate superior performance with limited computational complexity.

By Kevin Mancini, Islem Rekik
arXiv Machine Learning
Oct 2

Model-to-Data Distillation for Graph Neural Networks

The paper introduces Model-to-Data (M2D) distillation, a method that transfers properties learned by a complex graph neural network (GNN) teacher into the graph data itself. By jointly learning augmented node features and graph structure, M2D encodes the teacher’s behavior, allowing simpler GNNs to recover high predictive performance, fairness, and robustness. The resulting graph can be reused with various downstream models, enabling them to approximate sophisticated teachers such as fairness-aware GNNs, Graph Attention Networks, and Graph Transformers.

By Debolina Halder Lina, Arlei Silva
arXiv Machine Learning
Aug 19

HyPE-GT: where Graph Transformers meet Hyperbolic Positional Encodings

HyPE-GT introduces a framework that generates learnable hyperbolic positional encodings for Graph Transformers, enabling the capture of complex hierarchical relationships in graph-structured data. Unlike traditional Euclidean encodings, HyPE’s hyperbolic encodings can be selected to suit specific downstream tasks and help mitigate oversmoothing in deep Graph Neural Networks. Experiments on molecular benchmarks and large-scale Open Graph Benchmark datasets demonstrate improved performance, while additional tests on Coauthor and Copurchase networks confirm HyPE’s effectiveness in controlling oversmoothing.

By Kushal Bose, Swagatam Das