arXiv AI By Ryoma Sato

Training Graph Foundation Models on The Web Graph

Read the original on arXiv AI →

The paper introduces Acacia, a graph foundation model trained on the Common Crawl web graph. Acacia can handle arbitrary feature dimensionalities and semantics, perform node classification, link prediction, node clustering, and graph generation, and exhibit in-context learning—all without additional training or pretrained LLMs. Unlike existing models that require extra heads or rely on LLMs, Acacia is trained from scratch and can adapt to new graphs and labels directly.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jun 17

Handling Feature Heterogeneity with Learnable Graph Patches

arXiv:2606. 17667v1 Announce Type: cross Abstract: In recent years, the rapid development of foundation models and graph pre-training technologies has spurred increasing interest in constructing a universal pre-trained graph model or Graph Foundation Model (GFM).

By Yifei Sun, Yang Yang, Xiao Feng, Zijun Wang, Haoyang Zhong, Chunping Wang, Lei Chen