arXiv Machine Learning

Structurally Speaking: Motif-Oriented Graph Captioning through Bidirectional Graph-Text Translation

The paper introduces Structurally Speaking, a lightweight structured prompting protocol that improves graph captioning by translating explicit connectivity into concise motif-level descriptions. It treats motif-oriented graph captioning as a bidirectional graph-text translation task, aiming to preserve topology for graph recovery while producing interpretable captions. Experiments on a synthetic motif-based dataset show that the protocol yields shorter, more motif-consistent captions without sacrificing graph recovery performance.

arXiv Machine Learning
Jun 11

GraspLLM: Towards Zero-Shot Generalization on Text-Attributed Graphs with LLMs

arXiv:2606. 11898v1 Announce Type: cross Abstract: Research on Text-Attributed Graphs (TAGs) has gained significant attention recently due to its broad applications across various real-world data scenarios, such as citation networks, e-commerce platforms, social media, and web pages.

By Hengyi Feng, Zeang Sheng, Meiyi Qiang, Meiyi Qiang, Wentao Zhang
arXiv Machine Learning
Sep 4

LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Models

The paper introduces PromptGFM, a Graph Foundation Model designed for text‑attributed graphs (TAGs). It integrates Large Language Models (LLMs) and Graph Neural Networks (GNNs) through a Graph Understanding Module that prompts LLMs to emulate GNN workflows, and a Graph Inference Module that creates a language‑based graph vocabulary for better alignment and scalability. Experiments show PromptGFM outperforms existing methods and transfers effectively across various graphs and tasks.

By Xi Zhu, Haochen Xue, Ziwei Zhao, Wujiang Xu, Jingyuan Huang, Minghao Guo, Qifan Wang, Kaixiong Zhou, Imran Razzak, Yongfeng Zhang
arXiv Machine Learning
Oct 23

On the Token Collapse Phenomenon in Textual Graph Soft Prompting

The paper investigates graph soft prompting, where a graph neural network generates graph-specific tokens for large language model prompts. It identifies a problem called token collapse, in which these tokens become nearly identical across different inputs, rendering them ineffective at conveying graph information. The authors show that even simple constant prompts can match or outperform collapsed tokens, and propose a two‑stage method to produce more varied tokens while maintaining performance.

By Andrea Giuseppe Di Francesco, Rishabh Jain, Franco Maria Nardini, Nicola Tonellotto, Pietro Li\`o, Fabrizio Silvestri