arXiv AI

Training Graph Foundation Models on The Web Graph

The paper introduces Acacia, a graph foundation model trained on the Common Crawl web graph. Acacia can handle arbitrary feature dimensionalities and semantics, perform node classification, link prediction, node clustering, and graph generation, and exhibit in-context learning—all without additional training or pretrained LLMs. Unlike existing models that require extra heads or rely on LLMs, Acacia is trained from scratch and can adapt to new graphs and labels directly.

arXiv AI
Jun 17

Handling Feature Heterogeneity with Learnable Graph Patches

arXiv:2606. 17667v1 Announce Type: cross Abstract: In recent years, the rapid development of foundation models and graph pre-training technologies has spurred increasing interest in constructing a universal pre-trained graph model or Graph Foundation Model (GFM).

By Yifei Sun, Yang Yang, Xiao Feng, Zijun Wang, Haoyang Zhong, Chunping Wang, Lei Chen