arXiv Machine Learning June 18, 2026 By Donald Loveland, Puja Trivedi, Ari Weinstein, Edward W Huang, Danai Koutra

Formalizing and Mitigating Structural Distortion in LLM Attention for Graph Reasoning

Read the original on arXiv Machine Learning →

arXiv:2606. 15633v2 Announce Type: replace Abstract: Large Language Models (LLMs) have shown promise for reasoning over Text-Attributed Graphs (TAGs).

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 16

Formalizing and Mitigating Structural Distortion in LLM Attention for Zero-Shot Graph Reasoning

arXiv:2606. 15633v1 Announce Type: new Abstract: Large Language Models (LLMs) have shown promise for reasoning over Text-Attributed Graphs (TAGs).

By Donald Loveland, Puja Trivedi, Ari Weinstein, Edward W Huang, Danai Koutra

llms rag benchmarks

arXiv AI

Jul 21

GRIP: In-Parameter Graph Reasoning through Fine-Tuning Large Language Models

arXiv:2511. 07457v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities in modeling sequential textual data and generalizing across diverse tasks.

By Jiarui Feng, Donghong Cai, Yixin Chen, Muhan Zhang

llms fine-tuning safety

arXiv AI

Jun 10

Lost in Serialization: Invariance and Generalization of LLM Graph Reasoners

arXiv:2511. 10234v3 Announce Type: replace-cross Abstract: While promising, graph reasoners based on Large Language Models (LLMs) lack built-in invariance to symmetries in graph representations.

By Daniel Herbst, Lea Karbevska, Divyanshu Kumar, Akanksha Ahuja, Fatemeh Gholamzadeh Nasrabadi, Fabrizio Frasca

llms fine-tuning benchmarks

arXiv AI

Jul 17

CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoning

arXiv:2607. 14114v1 Announce Type: cross Abstract: Graph learning under distribution shift presents a persistent challenge, where models adapt to new graphs with limited or even no supervision.

By Haohua Niu, Xingtong Yu, Yang Liu, Junfeng Fang, Xuanting Xie, Jie Tan, Zhongjian Zhang, Hong Cheng, Yuan Fang

llms benchmarks

arXiv AI

Jul 1

Improving LLM Reasoning with Homophily-aware Structural and Semantic Text-Attributed Graph Compression

arXiv:2601. 08187v3 Announce Type: replace Abstract: Large language models (LLMs) have demonstrated promising capabilities in Text-Attributed Graph (TAG) understanding.

By Zijun Di, Bin Lu, Huquan Kang, Luoyi Fu, Jiaxin Ding, Xiaoying Gan, Lei Zhou, Xinbing Wang

llms benchmarks

arXiv AI

5d ago

Unified Multi-Dimensional Benchmark for Complex Graph Reasoning in Large Language Models

arXiv:2608. 12391v1 Announce Type: cross Abstract: Graph reasoning provides a promising testbed for evaluating the reasoning ability of large language models (LLMs), as graph instances can be programmatically generated, structurally controlled, and naturally scaled to long-input settings.

By Fali Wang, Ali Al-Lawati, Iliyas Bektas, Jinxuan Fang, Alek Melenski, Tianxiang Zhao, Yao Ma, Suhang Wang

llms rag fine-tuning benchmarks

Related stories

Formalizing and Mitigating Structural Distortion in LLM Attention for Zero-Shot Graph Reasoning

GRIP: In-Parameter Graph Reasoning through Fine-Tuning Large Language Models

Lost in Serialization: Invariance and Generalization of LLM Graph Reasoners

CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoning

Improving LLM Reasoning with Homophily-aware Structural and Semantic Text-Attributed Graph Compression

Unified Multi-Dimensional Benchmark for Complex Graph Reasoning in Large Language Models