arXiv AI

OntoKG-EQ: A provenance-grounded, competency-question-governed knowledge graph for auditable analyst querying

arXiv AI
Aug 24

Auditable by Construction: An Ontology-Driven Framework for Trustworthy LLM Analytics in Enterprise Finance

The paper introduces the Knowledge-Driven Analytics Framework (KDAF), an ontology‑driven approach for large language model analytics in enterprise finance that prioritizes auditability. KDAF constructs knowledge systems through six iterative stages and retrieves evidence via Context‑Aware Relevance Propagation (CARP), ensuring each fact includes its relationship type, confidence, and source lineage. Evaluation on FinanceBench shows that while retrieval improves accuracy marginally, KDAF significantly outperforms other methods in citation traceability and provenance completeness, demonstrating that auditability is the key advantage of ontology‑grounded retrieval.

By Sergiy Lunyakin
arXiv AI
3d ago

FinMultiHopQA: A KG-Grounded Multi-Hop Financial QA Benchmark for Evidence-Driven Reasoning

FinMultiHopQA is a new benchmark comprising 15,600 financial questions that require multi‑hop reasoning across filing sections, fiscal years, and peer companies. It is grounded in FinReflectKG, a temporally indexed financial knowledge graph with over 17.5 million triples derived from SEC 10‑K filings. The benchmark uniquely supports controlled multi‑hop taxonomies, document topologies, motif‑level reproducibility, and provenance‑linked auditability, and it allows researchers to test how different evidence presentations affect large language model performance.

By Abhinav Arun, Reetu Raj Harsh, Bhaskarjit Sarmah, Stefano Pasquali
arXiv AI
Oct 31

What Does an Ontology Catch? Curated, LLM-Generated and Data-Derived Ontologies as Checkers of LLM Agents over Knowledge Graphs

The paper investigates how different types of ontologies—curated, LLM-generated, and data-derived—serve as checkers for large language model agents answering questions over knowledge graphs. By evaluating these ontologies as prompt context, as checkers, or both, across both open-weight and proprietary agents on public and a large private graph, the study quantifies the trade-offs between errors caught and false alarms. It finds that curated ontologies can flag more correct answers than other sources but are only marginally more precise than random, and that combining sources or providing specific feedback offers limited benefits.

By Michal Orzechowski, Rund Tawfiq, Tomasz Kosciolek
arXiv AI
Jun 16

Provenance-Enhanced Statements in Knowledge Graphs

arXiv:2606. 15246v1 Announce Type: cross Abstract: Provenance-enhanced statements of the form "according to $X$, $\varphi$" are pervasive in contemporary knowledge graphs, especially in domains where graph content primarily represents claims, interpretations, and hypotheses (\emph{capta}) rather than observer-independent facts (\emph{data}).

By Fabio Vitali, Valentina Pasqual
arXiv AI
Oct 31

Beyond Similarity Search: Knowledge Graph Metadata Enrichment for Enterprise Retrieval-Augmented Generation

The paper investigates whether a knowledge graph can enhance retrieval for enterprise retrieval‑augmented generation (RAG) systems compared to traditional similarity search. Using a snapshot of SEC EDGAR filings, the authors built a graph with 430,257 nodes and 561,144 edges, then evaluated three architectures—text‑to‑SQL, dense‑vector RAG, and a two‑stage GraphRAG. GraphRAG outperformed the other methods, correctly answering 16 of 20 questions across all attempts, while the other approaches lagged behind, especially in structured aggregation and single‑document queries.

By Fakabbir Amin
arXiv AI
Oct 31

Rebuilding a Field's Open-Problem Catalog from the Literature: A Two-Layer Knowledge Graph, and Why Status Must Stay Proposed

The paper presents a system that transforms open‑problem listings in research fields into a structured, queryable knowledge graph. It combines a hand‑curated problem layer with an evidence layer derived from bibliographic data, linked through typed, provenance‑carrying connections. The authors evaluate the approach on database and AI problem catalogs, showing that the new graph can answer all previously answerable queries and additional ones about recent work, but also reveal limitations in automated status judgments, leading to a design recommendation that status changes must be proposed with evidence and reviewed by humans.

By Madhulatha Mandarapu, Sandeep Kunkunuru
arXiv AI
Aug 7

Tytan: Interactive Neurosymbolic Construction of Analytic Semantic Schemas from Relational Data

arXiv:2608. 06331v1 Announce Type: cross Abstract: From natural-language query interfaces to automated report generation, data analysis tools need a description of the data: the real-world entities it contains, which columns function as measures or identifiers, and how tables connect into units of analysis.

By Donna Hooshmand, Shubham Shahi, Cameron Barrie, Abhratanu Dutta, Marko Sterbentz, Harper Pack, Kristian J. Hammond