arXiv Computation and Language October 28, 2026 By Yichi Zhang, Zhuo Chen, Lingbing Guo, Wen Zhang, Huajun Chen

Every Little Helps: Building Knowledge Graph Foundation Model with Fine-grained Transferable Multi-modal Tokens

Read the original on arXiv Computation and Language →

The paper introduces TOFU, a token-based foundation model for multi‑modal knowledge graph reasoning (MMKGR). TOFU converts structural, visual, and textual data into modality‑specific tokens and uses a hierarchical fusion architecture with mixture‑of‑message mechanisms to learn transferable features. Experiments on 17 MMKGs demonstrate that TOFU outperforms existing KGFM and MMKGR baselines, especially on unseen knowledge graphs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Machine Learning

Aug 3

Beyond Feature and Structure Alignment: Learning Transferable Propagation Knowledge for Graph Foundation Models

arXiv:2607. 28980v1 Announce Type: new Abstract: Graph Foundation Models (GFMs) have recently emerged as a promising paradigm for enabling knowledge transfer across diverse domains.

By Yi Wang, Jitao Zhao, Di Jin, Dongxiao He

safety

arXiv AI

Aug 7

ViSR-KGC: Visual Subgraph Reasoning with Vision-Language Models for Multimodal Knowledge Graph Completion

arXiv:2608. 05833v1 Announce Type: new Abstract: Knowledge graph completion (KGC) aims to infer missing entities or relations from incomplete graph structures, and has evolved into multimodal knowledge graph completion (MMKGC), where entities are associated with multiple modalities such as text and images.

By Jiafan Li, Mengxue Yang, Jiaqi Zhu, Liang Chang, Ying Li, Hongan Wang

llms rag multimodal

arXiv Machine Learning

Aug 11

Neural Message Passing on Structural Interaction Graphs for Fully-Inductive Graph Neural Networks

arXiv:2608. 08567v1 Announce Type: new Abstract: A central obstacle in building graph foundation models is the input heterogeneity in terms of feature space dimensionality, semantics, and structure.

By Omer Yom Tov, Avigdor Gal

safety

arXiv AI

Oct 5

KGPFN: Unlocking the Potential of Knowledge Graph Foundation Model via In-Context Learning

arXiv:2605.14907v2 Announce Type: replace Abstract: Knowledge graph (KG) foundation models aim to generalize to graphs with unseen entities and relations by learning transferable relational structure...

By Yisen Gao, Jiaxin Bai, Haoyu Huang, Zhongwei Xie, Yufei Li, Hong Ting Tsang, Sirui Han, Yangqiu Song

llms fine-tuning

arXiv AI

Jul 21

MMGraphRAG: Bridging Vision and Language with Interpretable Multimodal Knowledge Graphs

arXiv:2507. 20804v3 Announce Type: replace Abstract: Large Language Models (LLMs) suffer from hallucinations due to their static parametric knowledge.

By Xueyao Wan, Hang Yu

llms rag multimodal benchmarks safety

arXiv AI

Jun 3

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models

arXiv:2510. 09711v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches.

By Wenbin Guo, Xin Wang, Jiaoyan Chen, Lingbing Guo, Zhao Li, Zirui Chen

llms rag nlp efficiency benchmarks

One email a morning, machine-written

Related stories

Beyond Feature and Structure Alignment: Learning Transferable Propagation Knowledge for Graph Foundation Models

ViSR-KGC: Visual Subgraph Reasoning with Vision-Language Models for Multimodal Knowledge Graph Completion

Neural Message Passing on Structural Interaction Graphs for Fully-Inductive Graph Neural Networks

KGPFN: Unlocking the Potential of Knowledge Graph Foundation Model via In-Context Learning

MMGraphRAG: Bridging Vision and Language with Interpretable Multimodal Knowledge Graphs

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models