arXiv Machine Learning

Spectral Limits of Polynomial Graph Filters on the Long-Range Ising Model Benchmark

The paper introduces the Long‑Range Ising Model (LRIM) benchmark, which ensures long‑range dependence by defining each label as a node’s spin multiplied by a power‑law coupled spin field. It proves that polynomial filters on the adjacency matrix—used in isotropic message passing and spectral graph networks—cannot reduce the error floor because the target lies on a spectral level set where such filters are constant. The authors show that a strided filter with about fifty coefficients, trained on the labels, achieves a test error 52 times lower than the best published network, while a dilated convolutional network outperforms prior results at 256 nodes and matches them at 1,024 nodes, providing the first in‑domain results for larger sizes.

arXiv Machine Learning
Sep 25

Spectral Graph Neural Networks with Hermite Polynomials: A Comprehensive Study

The paper introduces HermNet, a spectral graph neural network that uses Hermite polynomials for nodewise prediction and normalized propagation, avoiding eigendecomposition or learned bases. It compares HermNet to other complete polynomial bases, examining how coordinate choices affect optimization under limited training. Experiments on synthetic and real data show regimes where HermNet outperforms alternatives, and analyze the impact of calibration, regularization, and training duration on performance.

By Shuang Wu
arXiv Machine Learning
Sep 17

Provable Guarantees for Spectral Structured Prediction

The paper presents provable guarantees for a spectral method that recovers binary node labels on signed graphs with edge‑flip noise. It provides graph‑structure‑agnostic bounds on approximate inference accuracy and maximum angle deviation, using matrix concentration and eigenvector perturbation techniques. The results connect to the Cheeger constant and are validated with synthetic experiments, marking the first theoretical analysis of this spectral approach.

By Violet Zheng, Jean Honorio
arXiv Machine Learning
Jun 16

Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs

arXiv:2602. 10031v2 Announce Type: replace Abstract: Graph neural networks (GNNs) are commonly divided into message-passing neural networks (MPNNs) and spectral GNNs, reflecting two largely separate research traditions in machine learning and signal processing.

By Antonis Vasileiou, Juan Cervino, Pascal Frossard, Charilaos I. Kanatsoulis, Christopher Morris, Michael T. Schaub, Pierre Vandergheynst, Zhiyang Wang, Guy Wolf, Ron Levie