Auditing a KB Elicitation of Frontier LLM Knowledge: A Multi-dimensional Analysis of GPTKB v1.5

The paper presents a framework and results of a multi-dimensional analysis of GPTKB v1.5, a 100‑million‑fact knowledge base elicited from GPT‑4.1. It shows that the LLM’s factual knowledge differs markedly from established knowledge bases and that its accuracy is lower than suggested by prior benchmarks. The study also identifies inconsistency, ambiguity, and hallucinations as major issues, pointing to future research directions in neuro‑symbolic AI for extracting, consolidating, and verifying factual LLM knowledge.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• llms
• rag
• benchmarks
• safety