arXiv AI
Oct 19

NL2SQL with Iterative Self-Refinement

The paper presents a multi‑agent, persona‑driven NL2SQL framework that addresses common LLM shortcomings such as schema hallucination, syntax errors, and intent mismatch. It incorporates domain relevance detection, schema‑grounded knowledge construction, KPI‑aware SQL synthesis, syntax‑level self‑repair via sqlite feedback, and semantic consistency checking through SQL‑to‑NL reverse engineering. Evaluated on 60 queries, the system achieves 90% correctness using Mistral across seven coordinated LLM calls, demonstrating a significant improvement in reliability for high‑stakes environments.

By Anjali Vemula, Akshat Dasula
arXiv Computation and Language
4d ago

IndicDBBench - Benchmarking Multilingual Text-to-SQL Capabilities in Indian Languages

IndicDBBench is a new multilingual Text-to-SQL benchmark that evaluates cross‑lingual semantic parsing across 20 databases and 237 tables in seven languages, including English and six Indic languages. The benchmark uses real‑world open‑data schemas from NDAP and IDP, and a three‑agent pipeline to create complex relational structures with high relational density and join depths up to six. Evaluation of state‑of‑the‑art models shows a 9‑point drop in execution accuracy from English to Indic languages, revealing an "Indic Gap" that persists even when gold tables and literal values are supplied.

By Aviral Dawar, Roshan Karanth, Vikram Goyal, Rakhee Kulshrestha, Sumanta Pasari, Dhruv Kumar
arXiv AI
Jul 8

Spider 2.0-AIFunc: Extending Real-World Text-to-SQL to AI-Native SQL Workflows

arXiv:2607. 06229v1 Announce Type: cross Abstract: Major cloud data platforms now expose large language model capabilities as native SQL functions, enabling analysts to perform classification, filtering, sentiment analysis, extraction, similarity search, and aggregation within ordinary SQL queries.

By Tianyang Liu, Canwen Xu, Fangyu Lei, Nikki Lijing Kuang, Jixuan Chen, Tao Yu, Julian McAuley, Zhewei Yao, Yuxiong He
arXiv AI
Sep 18

Effective and Efficient Threat Hunting with Small Language Models

The paper presents a framework for translating natural‑language queries into Kusto Query Language (KQL) using small language models (SLMs). It introduces lightweight retrieval, error‑aware prompting, LoRA fine‑tuning with rationale distillation, and a two‑stage architecture that pairs an SLM drafter with a low‑cost LLM judge. Evaluations on Microsoft’s NL2KQL Defender dataset show the two‑stage approach achieving high syntax and schema‑valid accuracy while dramatically reducing cost compared to larger LLM baselines.

By Saleha Muzammil, Rahul Reddy, Vishal Kamalakrishnan, Hadi Ahmadi, Wajih Ul Hassan