arXiv Machine Learning

Rethinking Generalization in Knowledge Graph Embedding: An Empirical Study and Sparse Peak Regularization

arXiv AI
Jun 3

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models

arXiv:2510. 09711v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches.

By Wenbin Guo, Xin Wang, Jiaoyan Chen, Lingbing Guo, Zhao Li, Zirui Chen
arXiv Machine Learning
1d ago

When Forgotten Facts Return: Relearning-Aware Unlearning of Knowledge Graph Embeddings via Tangent Kernels

The paper introduces Kernel-Anticipated Unlearning (KAU), a method for approximate unlearning of knowledge-graph embeddings that accounts for relearning during continued training. KAU uses the tangent kernel to model how forgotten facts’ scores change, expressing this response in closed form and guiding edits to minimize future leakage. Experiments show KAU reduces leakage by 46‑63% on FB15k-237 and 50‑82% on CoDEx-L compared to the strongest existing unlearner, while preserving higher utility.

By Parnian Fazel, Mohammad M Maheri, Hamed Haddadi
arXiv AI
Sep 30

ImbalancE: Inference-Time Latent Search Against Degree Imbalance in Link Prediction

The paper introduces ImbalancE, an inference‑time latent search method that mitigates degree imbalance bias in Knowledge Graph Embedding models. It targets the problematic prediction of target entities with much lower degrees than anchor entities, a common issue in recommender systems and other applications. Experiments on benchmark datasets show that ImbalancE improves predictions on the most imbalanced triples compared to conventional methods.

By Alberto Bernardi, Luca Costabello, Christophe Gueret
arXiv Machine Learning
Oct 8

KGATE : a Knowledge Graph Embedding Training Environment

KGATE is a modular Python library for training knowledge graph embedding (KGE) models, built on PyTorch Geometric and TorchKGE. It allows users to assemble or plug in components such as initializers, encoders, decoders, losses, negative samplers, and evaluation metrics, and includes a preprocessing step to prevent data leakage. Benchmarks against six existing KGE libraries show that KGATE’s training time is comparable to the fastest while offering a broader set of features.

By Benjamin Loire, Galadriel Bri\`ere, C\'elia Brahimi, Antoine Toffano, Ana\"is Baudot
arXiv Machine Learning
Jul 14

Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion

arXiv:2506. 22036v2 Announce Type: replace Abstract: With the increasing multimodal knowledge privatization requirements, multimodal knowledge graphs in different institutes are usually decentralized, lacking of effective collaboration system with both stronger reasoning ability and transmission safety guarantees.

By Ying Zhang, Yu Zhao, Xuhui Sui, Baohang Zhou, Xiangrui Cai, Li Shen, Xiaojie Yuan, Dacheng Tao