arXiv AI

Do General NLP Embeddings Capture Ontological Reasoning?

The paper introduces AVA, a framework that tests whether general NLP embeddings can differentiate logic-sensitive relational semantics in ontologies and knowledge graphs. AVA uses 171,007 contrastive triplets from 163 ontologies, each containing an ontology statement, a paraphrase, and a hard negative with contradictory meaning. Evaluation of over 25 embedding models shows significant limitations, with the best model achieving only 0.739 triplet accuracy and 0.135 for hard negatives; fine‑tuning helps but does not transfer well to downstream Semantic Web tasks.

arXiv AI
Jun 3

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models

arXiv:2510. 09711v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches.

By Wenbin Guo, Xin Wang, Jiaoyan Chen, Lingbing Guo, Zhao Li, Zirui Chen
arXiv AI
Oct 2

LLM-Assisted Discovery of Typed Semantic Links for Ontology Network Construction

The paper presents an automated framework for building ontology networks by discovering typed semantic links between concepts across domains. It uses domain‑adapted DistilBERT embeddings, clustering to prune candidates, and GPT‑4o for generating interpretable relationships, reducing 800k raw pairs to 95k high‑quality candidates. Human validation on 429 links shows an 80.19% precision and 0.890 F1, outperforming five similarity‑based baselines and demonstrating the need for LLM reasoning in ontology link construction.

By Nouha Hayouni, Sheeba Samuel, Alsayed Algergawy
arXiv AI
Sep 10

Better Later Than Sooner: Neuro-Symbolic Knowledge Graph Construction via Ontology-grounded Post-extraction Correction

The paper introduces a neuro‑symbolic framework for constructing knowledge graphs (KGs) that are grounded in an ontology. It combines open‑domain extraction, embedding‑based canonicalization of types and predicates, and a post‑extraction LLM‑based correction step to fix ontology violations, thereby reducing token usage and improving KG consistency. The resulting KGs support symbolic querying, as evidenced by the prevalence of SPARQL graph patterns in the extracted data.

By Lorenzo Loconte, Timothy Hospedales, Cristina Cornelio
arXiv Machine Learning
5d ago

Peeling the Matryoshka: Extracting Ontological Structure from Retrieval Embeddings

The paper demonstrates that Matryoshka Representation Learning (MRL) embeddings contain a natural coarse‑to‑fine hierarchy, with prefix length aligning to gold taxonomy granularity. By training a simple order‑embedding probe called PEEL on these frozen embeddings, the authors can recover high‑fidelity taxonomic DAGs from a concept vocabulary alone, achieving strong results on two OLLM benchmarks and transferring to new domains without target‑edge supervision. The study shows that pre‑trained retrieval embeddings encode a decodable granularity gradient, enabling a minimal probe to extract explicit parent‑child (is‑a) structure.

By Eunchan Kim, Inwhee Joe