Hugging Face Trending Papers

KGCQual: An Interpretable Framework for Evaluating the Knowledge Graph Construction Quality from Text

Read the original on Hugging Face Trending Papers →

Knowledge Graphs (KGs) are increasingly constructed through automated extraction pipelines; however, such systems often introduce spurious or incomplete triples, which degrade downstream performance. Existing evaluation practices rely heavily on task-specific metrics or small-scale manual verification, offering limited insight into the structural and semantic fidelity of extracted graphs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI
Jul 14

KGCQual: An Interpretable Framework for Evaluating the Knowledge Graph Construction Quality from Text

arXiv:2607. 10212v1 Announce Type: new Abstract: Knowledge Graphs (KGs) are increasingly constructed through automated extraction pipelines; however, such systems often introduce spurious or incomplete triples, which degrade downstream performance.

By Nipun Misra, Vikranth Udandarao, Aanchal Gupta, Yogender Kumar, Manuj Mukherjee, Raghava Mutharaju
arXiv Computation and Language
Aug 28

Are Large Language Models Effective Knowledge Graph Constructors?

The paper investigates whether large language models (LLMs) can construct knowledge graphs (KGs) from documents in a zero‑shot, schema‑free manner. It introduces the Detail‑to‑Abstract Hierarchical Knowledge Graph (D2A‑HKG) framework, which splits KG construction into extraction, splitting, and abstraction stages, and evaluates the resulting graphs semantically and structurally. Using seven leading LLMs, the authors benchmark zero‑shot KG construction on CMW‑Lit—a dataset of pediatric mental‑wellness research—and find that state‑of‑the‑art LLMs generally produce relevant, document‑faithful triples with limited hallucination, though their extraction behaviors vary across stages. The study releases CMW‑Lit and the generated graphs as resources for future research and downstream knowledge‑intensive applications.

By Ruirui Chen, Weifeng Jiang, Chengwei Qin, Bo Xiong, Kaiwen Wei, Fiona Liausvia, Pei Fang Tan, Ker Yung Chua, Dongkyu Choi, Mukkesh Kumar, Evelyn C. Law, Dennis Wang, Boon Kiat Quek
arXiv AI
Aug 18

A Large-Scale Chinese Knowledge Graph-Text Alignment Dataset for Benchmarking Knowledge-Grounded LLMs

arXiv:2510. 06039v2 Announce Type: replace-cross Abstract: Reliable evaluation of knowledge-grounded Large Language Models (LLMs) in Chinese requires resources that explicitly align Chinese-language text with verifiable Knowledge Graph (KG) facts.

By Chengwei Wu, Xingrui Zhuo, Mingyang Gao, Xinghe Cheng, Zhichao Yan, Jiapu Wang