arXiv AI August 14, 2026 By Fali Wang, Ali Al-Lawati, Iliyas Bektas, Jinxuan Fang, Alek Melenski, Tianxiang Zhao, Yao Ma, Suhang Wang

Unified Multi-Dimensional Benchmark for Complex Graph Reasoning in Large Language Models

Read the original on arXiv AI →

arXiv:2608. 12391v1 Announce Type: cross Abstract: Graph reasoning provides a promising testbed for evaluating the reasoning ability of large language models (LLMs), as graph instances can be programmatically generated, structurally controlled, and naturally scaled to long-input settings.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Jun 3

Code-on-Graph: Iterative Programmatic Reasoning via Large Language Models on Knowledge Graphs

arXiv:2606. 03705v1 Announce Type: new Abstract: Knowledge Graphs (KGs) are widely used to mitigate the limitations of Large Language Models (LLMs), such as outdated knowledge and hallucinations.

By Weiwei Ding, Zixuan Li, Long Bai, Zhuo Chen, Kun Su, Fei Wang, Xiaolong Jin, Jin Zhang, Jiafeng Guo, Xueqi Cheng

llms benchmarks safety

arXiv Machine Learning

Sep 4

LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Models

The paper introduces PromptGFM, a Graph Foundation Model designed for text‑attributed graphs (TAGs). It integrates Large Language Models (LLMs) and Graph Neural Networks (GNNs) through a Graph Understanding Module that prompts LLMs to emulate GNN workflows, and a Graph Inference Module that creates a language‑based graph vocabulary for better alignment and scalability. Experiments show PromptGFM outperforms existing methods and transfers effectively across various graphs and tasks.

By Xi Zhu, Haochen Xue, Ziwei Zhao, Wujiang Xu, Jingyuan Huang, Minghao Guo, Qifan Wang, Kaixiong Zhou, Imran Razzak, Yongfeng Zhang

llms fine-tuning safety

arXiv AI

Jul 21

GRIP: In-Parameter Graph Reasoning through Fine-Tuning Large Language Models

arXiv:2511. 07457v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities in modeling sequential textual data and generalizing across diverse tasks.

By Jiarui Feng, Donghong Cai, Yixin Chen, Muhan Zhang

llms fine-tuning safety

arXiv Computer Vision

Sep 22

Visual Graph Reasoning via Knowledge Compilation

arXiv:2609.22327v1 Announce Type: cross Abstract: Visual graph reasoning requires answering graph-theoretic questions directly from graph images, where graph topology and state are conveyed visually...

By Rongzheng Wang, Zhe Wang, Ke Qin, Rongwei Wang, Muquan Li, Yizhuo Ma, Yihong Huang, Jielei Wang, Shuang Liang

llms reinforcement-learning multimodal benchmarks

arXiv AI

Jul 17

CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoning

arXiv:2607. 14114v1 Announce Type: cross Abstract: Graph learning under distribution shift presents a persistent challenge, where models adapt to new graphs with limited or even no supervision.

By Haohua Niu, Xingtong Yu, Yang Liu, Junfeng Fang, Xuanting Xie, Jie Tan, Zhongjian Zhang, Hong Cheng, Yuan Fang

llms benchmarks

arXiv AI

Jun 16

AdaSTORM: Scaling LLM Reasoning on Dynamic Graphs via Adaptive Spatio-Temporal Multi-Agent Collaboration

arXiv:2606. 16328v1 Announce Type: new Abstract: Large Language Models (LLMs) demonstrate remarkable potential in dynamic graph reasoning, but suffer from a scaling bottleneck: current models can only handle graphs with tens of nodes, constrained by exponential reasoning overhead and finite context windows.

By Bing Hao, Ruijie Wang, Haodong Qian, Yunlong Chu, Yuhang Liu, Yumeng Lin, Minglai Shao, Jianxin Li

llms agents benchmarks

One email a morning, machine-written

Related stories

Code-on-Graph: Iterative Programmatic Reasoning via Large Language Models on Knowledge Graphs

LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Models

GRIP: In-Parameter Graph Reasoning through Fine-Tuning Large Language Models

Visual Graph Reasoning via Knowledge Compilation

CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoning

AdaSTORM: Scaling LLM Reasoning on Dynamic Graphs via Adaptive Spatio-Temporal Multi-Agent Collaboration