arXiv AI

Spectral Initialization and Scheduled Graph Smoothness for Uncertain Knowledge Graph Completion

The paper introduces QUEST, a method for uncertain knowledge graph completion that adds no trainable parameters to the standard pipeline. QUEST first initializes entity embeddings using the smallest non‑trivial eigenvectors of the confidence‑weighted graph Laplacian, thereby preserving community and hub structure before training. It then applies an unbiased mini‑batch Dirichlet energy regularizer to enforce early‑stage structural consistency, leading to improved confidence and link prediction on most metric‑dataset pairs and eliminating instability spikes on dense graphs.

arXiv AI
Sep 3

PEARL: Path-Entity Aligned Relational Learning with Contextual Subgraphs for Inductive Knowledge Graph Completion

PEARL is a new framework for inductive knowledge graph completion that treats relational paths as context-conditioned reasoning signals. It builds a query‑specific contextual subgraph from the query entities’ neighborhoods and uses a large language model‑guided retriever to select semantically relevant paths. By constructing a bipartite interaction graph over paths, contextual entities, and a global subgraph representation, and applying a dual‑view contrastive objective, PEARL adapts path embeddings to local and global structural evidence, achieving the best average Hits@10 on WN18RR, FB15k‑237, and NELL‑995.

By Yunchi Yang, Longlong Li, Cunquan Qu
arXiv AI
Jun 3

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models

arXiv:2510. 09711v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches.

By Wenbin Guo, Xin Wang, Jiaoyan Chen, Lingbing Guo, Zhao Li, Zirui Chen
arXiv Machine Learning
2d ago

Distilling Graph Geometry: Knowledge Gap from GNNs to MLPs

The paper introduces G^2MLP, a graph‑free MLP trained via distillation from a GNN teacher while preserving the teacher’s graph‑induced geometry. It identifies two spectral failure modes—underfit on sparse graphs and overfit on dense graphs—caused by neglecting geometry during distillation. By using Ollivier‑Ricci curvature to guide supervision between prediction‑level and representation‑level alignment, G^2MLP improves node‑classification performance and reduces the teacher‑student rank gap across benchmarks.

By Zhewei Chen, Hao Zhu, Jiaojiao Jiang, Ahad N. Zehmakan
arXiv Machine Learning
Sep 25

BLADE: Distilled LLM Regularization for Calibrated Knowledge Graph Completion

BLADE is a variational model for knowledge graph completion that separates latent truth from graph recording and uses distilled offline language‑model judgments as a frozen teacher regularizer. The model provides calibrated probabilities and epistemic uncertainty through posterior samples, while the teacher is only an optional triage factor during inference. Across five benchmarks, BLADE matches ranking performance and significantly reduces expected calibration error, improving ECE, Brier score, and NLL over several baselines, and shows strong performance under controlled missingness and leakage stress tests.

By Ibne Farabi Shihab, Rabeya Bosri Tamanna, Abdo El Karaky, Sanjeda Akter, Anuj Sharma
arXiv AI
Jun 17

Handling Feature Heterogeneity with Learnable Graph Patches

arXiv:2606. 17667v1 Announce Type: cross Abstract: In recent years, the rapid development of foundation models and graph pre-training technologies has spurred increasing interest in constructing a universal pre-trained graph model or Graph Foundation Model (GFM).

By Yifei Sun, Yang Yang, Xiao Feng, Zijun Wang, Haoyang Zhong, Chunping Wang, Lei Chen
arXiv Machine Learning
Sep 3

GONE: Structural Knowledge Unlearning via Neighborhood-Expanded Distribution Shaping

The paper introduces GONE, a benchmark for evaluating knowledge unlearning in large language models using structured knowledge graphs, and presents Neighborhood-Expanded Distribution Shaping (NEDS), a framework that leverages graph connectivity to separate forgotten facts from their semantic neighborhood. GONE disentangles direct fact removal, reasoning-based leakage, and catastrophic forgetting, while NEDS achieves high unlearning efficacy and locality on LLaMA-3-8B and Mistral-7B. The dataset is publicly available on Hugging Face.

By Chahana Dahal, Ashutosh Balasubramaniam, Zuobin Xiong