arXiv AI
Which Algorithms Can Graph Neural Networks Learn?
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jun 8
Learning to Execute Graph Algorithms Exactly with Graph Neural Networks
arXiv:2601. 23207v2 Announce Type: replace-cross Abstract: Understanding what graph neural networks can learn, especially their ability to learn to execute algorithms, remains a central theoretical challenge.
arXiv Statistics ML
Oct 2
Transferable Graph Metanetworks
Transferable Graph Metanetworks extend the graph metanetwork paradigm to predict properties of neural networks of varying widths. By enforcing invariance to width-dependent representations and continuity across similar functions, the proposed modifications enable robust size generalization, especially for networks trained under the maximal‑update parameterization (μP) up to 42× the training width. The authors provide empirical evidence across multiple tasks and theoretical guarantees in the infinite‑width limit, explaining both successes and limitations under different parameterizations.
arXiv Machine Learning
Oct 7
Neural Algorithmic Reasoning for Graph Saddle Point Problems
The paper introduces “GraphPDHG,” a message‑passing neural network that aligns with the Chambolle‑Pock Primal–Dual Hybrid Gradient algorithm to solve general graph saddle‑point problems. The authors prove that “GraphPDHG” can efficiently simulate PDHG and can learn an accelerated version of the algorithm. Experiments demonstrate that the learned warm start improves second‑order optimizers and that alignment with PDHG yields better size generalization compared to standard GNN baselines.
arXiv Machine Learning
Jul 30
On the Rademacher Complexity of Graph Neural Networks: Unifying Expressivity and Geometry
arXiv:2510. 10101v4 Announce Type: replace Abstract: Understanding the interplay between generalization, expressivity, and the geometry of the input space is a central challenge in graph learning.
arXiv Machine Learning
Jul 24
New Complexity-Theoretic Frontiers of Tractability for Neural Network Training
arXiv:2607. 20811v1 Announce Type: new Abstract: In spite of the fundamental role of neural networks in contemporary machine learning research, our understanding of the computational complexity of optimally training neural networks remains incomplete even when dealing with the simplest kinds of activation functions.
arXiv AI
Jul 15
Efficiently Learning Branching Networks for Multitask Algorithmic Reasoning
arXiv:2512. 01113v2 Announce Type: replace-cross Abstract: Algorithmic reasoning -- the ability to perform step-by-step logical inference -- is a synthetic benchmark for evaluating multi-step reasoning abilities, designed for graph neural networks and also for transformer models.