arXiv AI

Graph is a Natural Regularization: Revisiting Vector Quantization for Graph Representation Learning

arXiv:2508. 06588v3 Announce Type: replace-cross Abstract: Vector Quantization (VQ) has recently emerged as a promising approach for learning compressed and discrete representations for graph-structured data.

arXiv Machine Learning
4d ago

Lost in Tokenization: Fundamental Trade-offs in Graph Tokenization for Transformers

The paper investigates how the choice of graph tokenization affects transformer expressivity. It analyzes three tokenization families—spectral, random‑walk, and adjacency—showing that each induces different depth requirements and that some tokenizations are inherently lossy or ill‑conditioned for certain tasks. The authors prove lower bounds and impossibility results for converting between tokenizations and validate these findings with experiments on synthetic and real‑world data.

By Maya Bechler-Speicher, Gilad Yehudai, Gil Harari, Clayton Sanford, Amir Globerson, Joan Bruna
arXiv Machine Learning
Aug 28

Inductive Correlation Clustering with Graph Neural Networks

The paper introduces Inductive Correlation Clustering, a new framework that uses Graph Neural Networks to solve the Correlation Clustering problem on unseen graph instances. By learning common structural patterns and node features, the method generalizes to new graphs with minimal computational overhead, achieving inference times up to five orders of magnitude faster while maintaining an approximation ratio within about 10% of the best baseline. It also demonstrates competitive performance on standard transductive benchmarks and serves as an efficient learnable pooling layer for graph classification tasks.

By Francesco Paolo Nerini, Francesco Bonchi, Arijit Khan, Andr\'e Panisson
arXiv Machine Learning
Aug 4

Rethinking Federated Graph Foundation Models: A Graph-Language Alignment-based Approach

arXiv:2601. 21369v2 Announce Type: replace Abstract: Recent studies of federated graph foundational models (FedGFMs) break the idealized and untenable assumption of having centralized data storage to train graph foundation models, and accommodate the reality of distributed, privacy-restricted data silos.

By Yinlin Zhu, Di Wu, Xianzhi Zhang, Yuming Ai, Xunkai Li, Miao Hu, Guocong Quan
arXiv AI
Jun 17

Handling Feature Heterogeneity with Learnable Graph Patches

arXiv:2606. 17667v1 Announce Type: cross Abstract: In recent years, the rapid development of foundation models and graph pre-training technologies has spurred increasing interest in constructing a universal pre-trained graph model or Graph Foundation Model (GFM).

By Yifei Sun, Yang Yang, Xiao Feng, Zijun Wang, Haoyang Zhong, Chunping Wang, Lei Chen