arXiv Machine Learning

A Unifying Relational Perspective on Expressive Lottery Tickets

The paper extends the Strong Expressive Lottery Ticket Hypothesis to relational and temporal graph neural networks by proving that sufficiently large RGNNs contain sparse subnetworks preserving 1‑relational Weisfeiler‑Leman expressivity. It derives a probabilistic lower bound for random pruning to achieve such subnetworks and shows that common TGNNs and cross‑graph message passing can be reformulated as RGNNs to inherit these guarantees. Experiments validate the bound, compare it to empirical probabilities on synthetic data, and explore the relationship between pre‑training expressivity, optimization behavior, and prediction quality on temporal and molecular benchmarks.

Hugging Face Trending Papers
Aug 19

A Unifying Relational Perspective on Expressive Lottery Tickets

The paper investigates how sparsity impacts the expressivity of graph neural networks, focusing on relational and temporal variants. It extends the Strong Expressive Lottery Ticket Hypothesis to multi-relational and temporal domains, proving that sufficiently large RGNNs contain sparse subnetworks that preserve 1‑RWL expressivity and providing a probabilistic bound for random pruning. Experiments validate the theoretical bounds, compare them to empirical results on synthetic data, and explore the relationship between pre‑training expressivity, optimization behavior, and prediction quality on temporal and molecular benchmarks.

arXiv AI
Jun 9

What Makes a Desired Graph for Relational Deep Learning?

arXiv:2606. 08491v1 Announce Type: new Abstract: Relational deep learning (RDL) converts relational databases (RDBs) into heterogeneous graphs, but graphs derived directly from database schemas are often not well suited for how graph neural networks (GNNs) perform relational reasoning.

By Yao Cheng, Siqiang Luo
arXiv AI
Aug 25

Which Algorithms Can Graph Neural Networks Learn?

arXiv:2602.13106v2 Announce Type: replace-cross Abstract: In recent years, there has been growing interest in understanding neural architectures' ability to learn to execute discrete algorithms, a li...

By Solveig Wittig, Antonis Vasileiou, Robert R. Nerem, Timo Stoll, Floris Geerts, Yusu Wang, Christopher Morris
arXiv AI
Oct 2

Graph Hierarchical Recurrence for Long-Range Generalization

Graph Hierarchical Recurrence (GHR) is a new framework that enhances Graph Neural Networks and Graph Transformers by jointly processing the input graph and a pooled hierarchical abstraction. It addresses the limitation of existing models in handling predictions that depend on correlations between distant graph regions, especially under out-of-range generalization where test instances require interactions beyond training distances. Across many long-range benchmarks, GHR consistently improves performance, achieving state‑of‑the‑art or competitive results on multiple tasks.

By Stefano Carotti, Marco Pacini, Alessio Gravina, Davide Bacciu, Bruno Lepri, Sebastiano Bontorin
arXiv AI
Oct 31

Bridging Semantics and Structure: A Theoretically Grounded Framework for Link Prediction on TAGs

Bridge-LP is a new framework for link prediction on text‑attributed graphs that combines Graph Neural Networks and Language Models. It introduces three design components: jumping connections for robust language model training, compressed embeddings to encode neighborhood information, and a cache embedding strategy to reduce computational cost. Experiments on nine datasets show that Bridge‑LP outperforms 40 existing models, achieving up to a 43.06% improvement in Mean Reciprocal Rank.

By Chen Shao, Ruirui Wang, Tobias Kafer, Danai Koutra
arXiv Machine Learning
Aug 28

SLM-Conditioned Hierarchical Relation Routing for Labeled Property Graph Learning

The paper introduces SLM-Conditioned Hierarchical Relation Routing, a graph neural network architecture that incorporates a small language model to guide message selection in labeled property graphs. It combines structural states, node and relationship property encodings, and relationship types into messages, then uses a parameter‑efficient language model to generate target‑conditioned routing queries that filter relevant messages and route information across relation‑level summaries. The resulting representation updates a topology anchor with bounded residuals, preserving structural evidence while allowing contextual semantic information to influence predictions, and offers interpretable analysis at both neighbor and relationship‑type levels.

By Michal Podstawski