arXiv AI
Aug 13
DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation
arXiv:2608. 11889v1 Announce Type: cross Abstract: Prompting-based (\textit{i}.
What Predicts Correctness in Text-to-SQL? A Selective-Prediction Study
arXiv:2607. 06799v1 Announce Type: cross Abstract: Evaluating uncertainty in AI-generated SQL queries requires estimating whether a query is correct, where correct means it executes to the same result as a human-written reference.
Related stories
Hugging Face Trending Papers
Jun 29
How Far Do On-Prem Open LLMs Get on Text-to-SQL? A Cross-Family Size x Technique Frontier on BIRD
Organizations that cannot send data to a cloud API increasingly ask: how good is Text-to-SQL if the model must run on-premises on open weights, and which popular accuracy "recipes" are worth their compute? We answer with an honest, fully reproducible benchmark on the BIRD development split (n=1534, Execution Accuracy), evaluating three open model families across two generations -- Qwen2.
arXiv AI
Jul 24
ReliableTableQA:How Much Supervision Does Reliability Annotation Need?
arXiv:2607. 20537v1 Announce Type: cross Abstract: We introduce ReliableTableQA, a framework for training an LLM to annotate the statistical reliability of tabular QA results, not whether the query is answerable, but whether the computed answer is statistically meaningful.
arXiv Machine Learning
Jun 30
How Far Do On-Prem Open LLMs Get on Text-to-SQL? A Cross-Family Size x Technique Frontier on BIRD
arXiv:2606. 29733v1 Announce Type: cross Abstract: Organizations that cannot send data to a cloud API increasingly ask: how good is Text-to-SQL if the model must run on-premises on open weights, and which popular accuracy "recipes" are worth their compute?
arXiv AI
Aug 17
Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact
arXiv:2608. 13926v1 Announce Type: new Abstract: Large language models have made natural language interfaces to databases (NLIDB) newly credible, but LLM text-to-SQL systems fail in a way that matters for deployment: a hallucinated column or a mis-aggregated total yields a fluent wrong answer, indistinguishable at the point of use from a right one.
arXiv Computation and Language
Aug 24
Human-Level Text-to-SQL via Reinforcement Learning on Verified Data, Without Pipeline Engineering
arXiv:2603.20004v4 Announce Type: replace-cross Abstract: Translating natural language questions to SQL queries (Text-to-SQL) is a long-standing problem in database research. Recent efforts have focu...
arXiv Computation and Language
Aug 25
TraceSQL: Traceable Answerability Estimation for Reference-Free Text-to-SQL Verification
arXiv:2608.17795v2 Announce Type: replace Abstract: Text-to-SQL systems are commonly evaluated using ground-truth SQL queries or reference execution results, but such supervision is unavailable at in...
Hugging Face Trending Papers
Aug 14
Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact
Large language models have made natural language interfaces to databases (NLIDB) newly credible, but LLM text-to-SQL systems fail in a way that matters for deployment: a hallucinated column or a mis-a...
arXiv AI
2d ago
On-Device Named-Entity Recognition: A Deployability Study of Accuracy, Cost, Reliability, and Confidence
The paper evaluates nine on‑device named‑entity recognition models ranging from classical taggers to large language models, measuring not only accuracy but also latency and output validity. Using a silver‑gold benchmark derived from an LLM judge panel and a human‑validated corpus, the study shows that encoder‑based models achieve comparable accuracy to a 4 B instruct LLM while being much smaller, faster, and producing no malformed output. Confidence calibration of GLiNER is analyzed, revealing over‑confidence but improved reliability after temperature scaling and thresholding.
arXiv AI
Jul 7
TabQueryBench: A Query-Centric Benchmark for Synthetic Tabular Data
arXiv:2607. 03926v1 Announce Type: cross Abstract: Synthetic tabular data support use cases like data sharing, model development under access restrictions, and rapid prototyping of analytical workflows.
arXiv AI
2d ago
BudgetSchemaBench: A Budget-Swept Diagnostic for Schema Context in Text-to-SQL
BudgetSchemaBench is a diagnostic tool for evaluating how different schema‑context budgets affect text‑to‑SQL systems. It automatically derives relevance labels from gold SQL, tests four budgets across 80 databases, and compares three schema representations while keeping table rankings fixed. The study shows that increasing the budget improves execution accuracy, especially for lexical retrieval, and that dense retrieval already captures most needed tables at low budgets.
arXiv AI
Jun 11
TAHOE: Text-to-SQL with Automated Hint Optimization from Experience
arXiv:2606. 12387v1 Announce Type: cross Abstract: Large Language Models (LLMs) have democratized database access through Text-to-SQL, but moving from prototypes to production remains difficult.