arXiv AI

Graph Foundation Models for Recommendation: A Comprehensive Survey

The article surveys graph foundation models (GFMs) for recommender systems, highlighting how they combine graph neural networks (GNNs) and large language models (LLMs) to better capture user-item relationships and textual data. It offers a taxonomy of current GFM approaches, discusses methodological details, and identifies key challenges and future research directions. The survey aims to provide comprehensive insights into the evolving landscape of GFM-based recommender systems.

arXiv Computation and Language
Oct 7

Enhancing High-order Interaction Awareness in LLM-based Recommender Model

The paper introduces ELMRec, an enhanced LLM-based recommender that improves high-order interaction awareness by using whole-word embeddings to better interpret graph-constructed user-item interactions without graph pre-training. It also identifies that LLMs tend to prioritize earlier user interactions over recent ones and proposes a reranking solution. ELMRec achieves superior performance compared to state-of-the-art methods in both direct and sequential recommendation tasks.

By Xinfeng Wang, Jin Cui, Fumiyo Fukumoto, Yoshimi Suzuki
arXiv AI
3d ago

Bridging Semantics and Structure: A Theoretically Grounded Framework for Link Prediction on TAGs

Bridge-LP is a new framework for link prediction on text‑attributed graphs that combines Graph Neural Networks and Language Models. It introduces three design components: jumping connections for robust language model training, compressed embeddings to encode neighborhood information, and a cache embedding strategy to reduce computational cost. Experiments on nine datasets show that Bridge‑LP outperforms 40 existing models, achieving up to a 43.06% improvement in Mean Reciprocal Rank.

By Chen Shao, Ruirui Wang, Tobias Kafer, Danai Koutra
arXiv Machine Learning
Aug 28

SLM-Conditioned Hierarchical Relation Routing for Labeled Property Graph Learning

The paper introduces SLM-Conditioned Hierarchical Relation Routing, a graph neural network architecture that incorporates a small language model to guide message selection in labeled property graphs. It combines structural states, node and relationship property encodings, and relationship types into messages, then uses a parameter‑efficient language model to generate target‑conditioned routing queries that filter relevant messages and route information across relation‑level summaries. The resulting representation updates a topology anchor with bounded residuals, preserving structural evidence while allowing contextual semantic information to influence predictions, and offers interpretable analysis at both neighbor and relationship‑type levels.

By Michal Podstawski
arXiv AI
Aug 28

Rethinking Message Passing as Retrieval for Text-Attributed Graph Learning

The paper reinterprets graph neural networks (GNNs) as retrieval-augmented models, where each layer uses an MLP on a node representation and a permutation‑invariant summary of retrieved graph context instead of traditional message passing. It introduces RTA, a lightweight MLP‑based framework that replaces structural message passing with label‑aware retrieval and propagation, and provides theoretical links to softmax‑attention message passing and robustness to mis‑retrieved outliers. Experiments on text‑attributed graph benchmarks demonstrate that RTA matches or surpasses strong GNN and graph LLM baselines while improving efficiency and robustness.

By Jintang Li, Yuhong Chen, Ruofan Wu, Binli Luo, Jiayi Ji, Hui Li, Rongrong Ji