arXiv Computation and Language

IfcLLM: Natural Language Querying of IFC Models through Complementary Relational and Graph Representations

IfcLLM is a framework that enables natural language querying of Industry Foundation Classes (IFC) models by combining relational and graph data representations. It routes attribute retrieval queries to a relational backend and spatial reasoning queries to a graph backend, with an LLM agent coordinating the process through iterative retry-and-refine reasoning. In tests on 30 query scenarios across three IFC models, the best configuration achieved 96% accuracy, and experiments with open-weight LLMs suggest the approach can be deployed locally in data-sensitive AEC environments.

arXiv Machine Learning
Oct 22

RelAgent: LLM Agents as Data Scientists for Relational Learning

RelAgent is an LLM-based autonomous data scientist designed for relational learning. It operates in two phases: first, the LLM agent constructs SQL feature programs and selects a predictive model using database, validation, and evaluation tools; second, the resulting program is executed without further LLM calls. The final predictor combines SQL queries and a classical model, providing fast, deterministic, and interpretable predictions that rely solely on human-readable query-defined features.

By Xingyue Huang, Louis Tichelman, Jinwoo Kim, Krzysztof Olejniczak, \.Ismail \.Ilkan Ceylan
arXiv AI
Oct 19

NL2SQL with Iterative Self-Refinement

The paper presents a multi‑agent, persona‑driven NL2SQL framework that addresses common LLM shortcomings such as schema hallucination, syntax errors, and intent mismatch. It incorporates domain relevance detection, schema‑grounded knowledge construction, KPI‑aware SQL synthesis, syntax‑level self‑repair via sqlite feedback, and semantic consistency checking through SQL‑to‑NL reverse engineering. Evaluated on 60 queries, the system achieves 90% correctness using Mistral across seven coordinated LLM calls, demonstrating a significant improvement in reliability for high‑stakes environments.

By Anjali Vemula, Akshat Dasula
arXiv AI
Oct 2

Build2SPARQL: A Large-Scale Text-to-SPARQL Benchmark Dataset for Building Knowledge Graph Querying

Build2SPARQL is a large-scale benchmark dataset for translating natural-language questions into SPARQL queries over building knowledge graphs. The dataset is generated by a KG‑grounded pipeline that produces 6,136 executable SPARQL queries and 30,680 corresponding natural-language questions across six query-pattern families and five vocabulary registers, covering 201 building KGs. Human validation shows high semantic fidelity, naturalness, and operational plausibility, and retrieval‑augmented evaluation demonstrates significant accuracy gains for open‑weight language models.

By Wooyoung Jung
arXiv AI
Oct 7

Natural Language Questions as an Interface for Knowledge Graphs: QRAKEN Graph Distillation and Semantic Self-Healing

The paper introduces QRAKEN, a training‑free, ontology‑agnostic neurosymbolic pipeline that grounds natural‑language queries to RDF knowledge graphs using empirical graph evidence instead of schema expectations. QRAKEN distills a compact TTQL representation offline, then uses it online to guide large language models, providing deterministic checks and an iterative refinement loop. On the CK25 benchmark, QRAKEN achieves a strict F1 of 0.643–0.652 with GPT‑4.1 mini and GPT‑5.4, outperforming state‑of‑the‑art systems and demonstrating the effectiveness of empirical pattern distillation over schema‑only approaches.

By Remo Grillo, Lukas Klic, Giovanni Colavizza
arXiv AI
Sep 15

Beyond Quacking: Deep Integration of Language Models and RAG into DuckDB

The paper introduces FlockMTL, an extension for database management systems that deeply integrates large language models and retrieval‑augmented generation into DuckDB. It provides model‑driven scalar and aggregate functions, cost‑based optimizations like batching and caching, and new SQL DDL abstractions (PROMPT and MODEL) to treat LLMs as first‑class schema objects. These features aim to simplify the development of knowledge‑intensive analytical applications by reducing the effort required to orchestrate heterogeneous data systems and manage LLM context.

By Anas Dorbani, Sunny Yasser, Jimmy Lin, Amine Mhedhbi
arXiv Machine Learning
Sep 14

GLaMoR: Consistency Checking of OWL Ontologies using Graph Language Models

The paper introduces GLaMoR, a reasoning pipeline that converts OWL ontologies into graph-structured data and applies a Graph Language Model (GLM) for consistency checking. It addresses the challenge of verifying ontology consistency, especially for large ontologies where classical reasoners become computationally expensive. Experiments on NCBO BioPortal ontologies show that GLaMoR achieves 95% accuracy and is 20 times faster than traditional reasoners.

By Justin M\"ucke, Ansgar Scherp