arXiv Computer Vision By Bangwei Guo, Xujiang Zhao, Yanchi Liu, Wei Cheng, Shengyu Chen, Dongyue Li, Masaharu Morimoto, Takayuki Kuroda, Dimitris Metaxas, Haifeng Chen

TopoAgent: A Structure-Aware Perception-to-Reasoning Framework for Diagram-to-Graph Topology Extraction with Large Vision-Language Models

Read the original on arXiv Computer Vision →

The paper introduces TopoBench-180, a human‑verified benchmark of 180 structural diagrams with canonical graph annotations, and TopoAgent, a perception‑to‑reasoning framework that extracts graph topology from diagrams using large vision‑language models. TopoAgent combines grounded perception, global structural priors, node inventory construction, local‑to‑global relation reasoning, and consistency enforcement to progressively build the target graph. Experiments demonstrate that TopoAgent surpasses strong baselines, particularly in edge extraction, thereby advancing multimodal structured understanding for diagram‑to‑graph tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computation and Language
Oct 12

MVGraph: Benchmarking LVLMs on Evidence Composition across Multi-View Visual Graph

MVGraph is a new benchmark designed to evaluate large vision‑language models on multi‑graph reasoning tasks where evidence is spread across multiple interrelated visual graph views. It contains 8,000 instances covering eight graph‑theoretic tasks derived from partial and temporal graph scenarios, and each instance is provably unsolvable from a single view. The benchmark also offers 29 diagnostic tasks with 64,000 instances to probe four core capabilities—Perception, Alignment, Composition, and Reasoning—providing golden intermediate representations for detailed analysis.

By Yingjie Zhu, Han Cheng, Xuefeng Bai, Youcheng Pan, Yang Xiang, Kehai Chen
arXiv Computer Vision
Oct 12

GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models

GraphVerse is a new benchmark for multimodal large language models that tests visual graph reasoning by combining perception, graph-based visual inputs, and multi-step reasoning. It introduces Graph-centric Image Editing strategies to actively challenge models while preserving semantics, and offers a VGR-Score metric that evaluates reasoning quality beyond simple answer accuracy. Experiments show current models have limitations in VGR and demonstrate the effectiveness of GraphVerse for broader multimodal reasoning tasks.

By Yuanfu Sun, Yuanhang Ren, Kang Li, Chuanhao Ji, Jiaxi Li, Jiajin Liu, Ninghao Liu, Qiaoyu Tan
arXiv AI
Aug 7

ViSR-KGC: Visual Subgraph Reasoning with Vision-Language Models for Multimodal Knowledge Graph Completion

arXiv:2608. 05833v1 Announce Type: new Abstract: Knowledge graph completion (KGC) aims to infer missing entities or relations from incomplete graph structures, and has evolved into multimodal knowledge graph completion (MMKGC), where entities are associated with multiple modalities such as text and images.

By Jiafan Li, Mengxue Yang, Jiaqi Zhu, Liang Chang, Ying Li, Hongan Wang
arXiv Machine Learning
Oct 5

Toward Omni Multimodal Graph Foundation Model: A Topology-Driven Binding Approach

The paper introduces GraphBind, a topology-driven method for multimodal graph foundation models that binds heterogeneous node modalities into a unified shared space using graph topology. By leveraging stable graph structure to organize self and neighborhood semantics, GraphBind adapts this integrated space for both discriminative and generative tasks. Experiments against 11 baselines show that GraphBind outperforms them, achieving up to 28.1% relative improvement on key tasks.

By Xunkai Li, Chenxi Wan, Yinlin Zhu, Wang Luo, Hongchao Qin, Rong-Hua Li, Guoren Wang
arXiv Computation and Language
Aug 24

Do Large Language Models Play Six Degrees of Separation? Measuring Topological Compression in Long-Context Manifolds

The paper shows that large language models (LLMs) naturally organize their hidden state manifolds into small‑world networks, enabling efficient multi‑hop reasoning. By converting similarity matrices into unweighted graphs, the authors trace connectivity between distant semantic anchors and find a sharp topological phase transition: deep reasoning layers compress conceptual distances into paths bounded by six semantic hops, while early syntactic layers remain fragmented. The framework is applied to zero‑shot hallucination detection in Retrieval‑Augmented Generation, revealing that factual generations preserve a ~3‑hop structure, whereas hallucinations collapse the topology.

By Md. Faiyaz Abdullah Sayeedi
arXiv AI
Aug 11

Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddings

arXiv:2603. 26798v2 Announce Type: replace-cross Abstract: Vision-language model (VLM) encoders such as CLIP enable strong retrieval and zero-shot classification in a shared image-text embedding space, yet the semantic organization of this space is rarely inspected.

By Gesina Schwalbe, Mert Keser, Moritz Bayerkuhnlein, Edgar Heinert, Annika M\"utze, Marvin Keller, Sparsh Tiwari, Georgii Mikriukov, Diedrich Wolter, Jae Hee Lee, Matthias Rottmann