The paper investigates how the textual serialization of knowledge graphs influences the performance of large language models (LLMs). It evaluates 15 different graph representation formats across nine advanced LLM configurations on tasks involving ontology-based knowledge extraction and structural graph reasoning. While knowledge extraction shows little sensitivity to serialization, structural reasoning accuracy varies significantly depending on the chosen format, model, query, and task, suggesting that graph serialization should be treated as a dynamic orchestration decision.
arXiv:2502.14932v2 Announce Type: replace Abstract: Extensive research has investigated the integration of large language models (LLMs) with knowledge graphs to enhance the reasoning process. However...
arXiv:2511. 07457v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities in modeling sequential textual data and generalizing across diverse tasks.
arXiv:2606. 03705v1 Announce Type: new Abstract: Knowledge Graphs (KGs) are widely used to mitigate the limitations of Large Language Models (LLMs), such as outdated knowledge and hallucinations.
The paper introduces a neuro‑symbolic framework for constructing knowledge graphs (KGs) that are grounded in an ontology. It combines open‑domain extraction, embedding‑based canonicalization of types and predicates, and a post‑extraction LLM‑based correction step to fix ontology violations, thereby reducing token usage and improving KG consistency. The resulting KGs support symbolic querying, as evidenced by the prevalence of SPARQL graph patterns in the extracted data.
KGFR introduces a Knowledge Graph Foundation Retriever that collaborates with large language models to enhance knowledge‑intensive question answering. By encoding relations with LLM‑generated descriptions and initializing entities from question roles, KGFR enables zero‑shot generalization to unseen knowledge graphs. Its Asymmetric Progressive Propagation technique efficiently handles large graphs, while a controllable reasoning loop allows the LLM to request candidate answers, supporting facts, and reasoning paths.
Enrich-on-Graph (EoG) is a flexible framework that uses large language models to enrich knowledge graphs, thereby bridging the semantic gap between structured graphs and unstructured queries in complex reasoning tasks. By leveraging LLMs’ prior knowledge, EoG enables efficient evidence extraction from knowledge graphs, achieving precise and robust reasoning while maintaining low computational costs and scalability. The authors also introduce three graph quality evaluation metrics for query‑graph alignment, theoretically validate their optimization objectives, and demonstrate state‑of‑the‑art performance on two KGQA benchmark datasets.
The paper introduces SymbolLKG, a neuro-symbolic framework that combines a Logical Knowledge Graph (LKG) with dynamic solver routing to improve logical reasoning in large language models. The LKG represents logical rules and constraints as topological nodes, enabling explicit modeling of dependencies extracted from text. A Logic Router dispatches tasks to the most suitable symbolic engine, supported by a topology-aware hybrid retrieval mechanism, and the approach outperforms existing prompting and RAG baselines on logical reasoning benchmarks.
arXiv:2604. 12503v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have shown remarkable capabilities across various tasks but remain prone to hallucinations in knowledge-intensive scenarios.
arXiv:2502. 11491v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have shown remarkable capabilities in natural language processing.
arXiv:2608.22974v1 Announce Type: new Abstract: Large language model (LLM) agents rely heavily on knowledge encoded in model parameters or presented as unstructured context. In domain-specific tasks,...
The paper introduces WFM, a Wiki Foundation Model designed to support complex agentic reasoning by combining dense document contexts with markdown-based topological linkages. It formalizes a Wiki Graph schema that preserves explicit topologies while embedding continuous semantics, and employs a query‑conditioned attentive aggregation for efficient message passing. The authors also propose an NCCL‑based protocol to reduce distributed system overhead, achieving a 10.5× training speedup and strong performance on long‑term memory and multi‑hop reasoning benchmarks.
The paper introduces SymbolLKG, a neuro-symbolic framework that combines a Logical Knowledge Graph (LKG) with dynamic solver routing to improve logical reasoning in large language models. The LKG represents logical rules and constraints as topological nodes, allowing explicit modeling of dependencies extracted from text. A Logic Router dispatches tasks to the most suitable symbolic engine, supported by a topology-aware hybrid retrieval mechanism, and the approach outperforms existing prompting and RAG baselines on logical reasoning benchmarks.