When Does Bigger Help? A Controlled Study of LLM Scale for Ontology Learning
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2607. 01977v1 Announce Type: new Abstract: Ontology learning (OL) aims to automatically construct structured knowledge models from text, yet progress remains fragmented across methods, domains, and evaluation practices.
The paper presents an automated framework for building ontology networks by discovering typed semantic links between concepts across domains. It uses domain‑adapted DistilBERT embeddings, clustering to prune candidates, and GPT‑4o for generating interpretable relationships, reducing 800k raw pairs to 95k high‑quality candidates. Human validation on 429 links shows an 80.19% precision and 0.890 F1, outperforming five similarity‑based baselines and demonstrating the need for LLM reasoning in ontology link construction.
arXiv:2609.10055v1 Announce Type: cross Abstract: Biomedical ontology normalization maps free-text expressions to standardized concepts, enabling consistent integration and analysis of biomedical dat...
Biomedical ontology normalization maps free-text expressions to standardized concepts, enabling consistent integration and analysis of biomedical data. This task remains challenging because lexical va...
The paper demonstrates that Matryoshka Representation Learning (MRL) embeddings contain a natural coarse‑to‑fine hierarchy, with prefix length aligning to gold taxonomy granularity. By training a simple order‑embedding probe called PEEL on these frozen embeddings, the authors can recover high‑fidelity taxonomic DAGs from a concept vocabulary alone, achieving strong results on two OLLM benchmarks and transferring to new domains without target‑edge supervision. The study shows that pre‑trained retrieval embeddings encode a decodable granularity gradient, enabling a minimal probe to extract explicit parent‑child (is‑a) structure.
The paper introduces MIOE, a causal‑abstraction benchmark designed to probe how large language models (LLMs) handle ontology engineering tasks such as entity typing and subsumption prediction. Using this benchmark, the authors evaluate several mechanistic interpretability methods—including SAE, DBM, and DAS—on Qwen3‑8B and Qwen3‑4B models, finding that distributed subspace interventions perform best but still mix with auxiliary class‑specific information. The study shows that while ontological predictions are accessible at a mechanistic level, current techniques do not yet isolate a clean, disentangled causal mechanism for ontological knowledge.