arXiv AI July 9, 2026 By Robert Richardson

What Predicts Correctness in Text-to-SQL? A Selective-Prediction Study

arXiv:2607. 06799v1 Announce Type: cross Abstract: Evaluating uncertainty in AI-generated SQL queries requires estimating whether a query is correct, where correct means it executes to the same result as a human-written reference.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Aug 13

DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation

arXiv:2608. 11889v1 Announce Type: cross Abstract: Prompting-based (\textit{i}.

By Anik Pramanik, Murat Kantarcioglu, Vincent Oria, Shantanu Sharma

llms fine-tuning benchmarks safety data-engineering

Hugging Face Trending Papers

Jun 29

How Far Do On-Prem Open LLMs Get on Text-to-SQL? A Cross-Family Size x Technique Frontier on BIRD

Organizations that cannot send data to a cloud API increasingly ask: how good is Text-to-SQL if the model must run on-premises on open weights, and which popular accuracy "recipes" are worth their compute? We answer with an honest, fully reproducible benchmark on the BIRD development split (n=1534, Execution Accuracy), evaluating three open model families across two generations -- Qwen2.

llms rag benchmarks data-engineering

arXiv AI

Jul 24

ReliableTableQA:How Much Supervision Does Reliability Annotation Need?

arXiv:2607. 20537v1 Announce Type: cross Abstract: We introduce ReliableTableQA, a framework for training an LLM to annotate the statistical reliability of tabular QA results, not whether the query is answerable, but whether the computed answer is statistically meaningful.

By Huei-Chung Hu, Hsin-Tai Wu, Koyo Kobayashi

llms fine-tuning data-engineering

arXiv Machine Learning

Jun 30

How Far Do On-Prem Open LLMs Get on Text-to-SQL? A Cross-Family Size x Technique Frontier on BIRD

arXiv:2606. 29733v1 Announce Type: cross Abstract: Organizations that cannot send data to a cloud API increasingly ask: how good is Text-to-SQL if the model must run on-premises on open weights, and which popular accuracy "recipes" are worth their compute?

By Vladimir Beskorovainyi

llms rag benchmarks data-engineering

arXiv AI

Aug 17

Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact

arXiv:2608. 13926v1 Announce Type: new Abstract: Large language models have made natural language interfaces to databases (NLIDB) newly credible, but LLM text-to-SQL systems fail in a way that matters for deployment: a hallucinated column or a mis-aggregated total yields a fluent wrong answer, indistinguishable at the point of use from a right one.

By Zhelun (Allen), Wu

llms agents fine-tuning benchmarks data-engineering

arXiv Computation and Language

Aug 24

Human-Level Text-to-SQL via Reinforcement Learning on Verified Data, Without Pipeline Engineering

arXiv:2603.20004v4 Announce Type: replace-cross Abstract: Translating natural language questions to SQL queries (Text-to-SQL) is a long-standing problem in database research. Recent efforts have focu...

By Yuxuan Zhu, Tengjun Jin, Yoojin Choi, Daniel Kang

llms reinforcement-learning fine-tuning benchmarks data-engineering

One email a morning, machine-written

Related stories

DexterSQL: Deep Schema Exploration and Rule-based Correction for Text-to-SQL Generation

How Far Do On-Prem Open LLMs Get on Text-to-SQL? A Cross-Family Size x Technique Frontier on BIRD

ReliableTableQA:How Much Supervision Does Reliability Annotation Need?

How Far Do On-Prem Open LLMs Get on Text-to-SQL? A Cross-Family Size x Technique Frontier on BIRD

Never the Number: Structural Abstention for AI Systems Whose Answers Are Consumed as Fact

Human-Level Text-to-SQL via Reinforcement Learning on Verified Data, Without Pipeline Engineering