Human-Level Text-to-SQL via Reinforcement Learning on Verified Data, Without Pipeline Engineering
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
DualSQL is a Text-to-SQL system that uses two agents sharing a single model backbone, enabling joint optimization via multi-agent reinforcement learning. The approach incorporates three database access tools for multi-step reasoning, rollout guardrails to stabilize training, and a new SQL correctness metric called robust execution match (REX). Trained on only 3,755 examples, DualSQL-4B reaches 68.0% execution accuracy on the BIRD dev set, while DualSQL-8B achieves 71.1%, surpassing prior state‑of‑the‑art single‑model solutions with 32B parameters.
arXiv:2606. 30851v1 Announce Type: cross Abstract: Improving the reliability of large language models (LLMs) at inference time is a central challenge in structured reasoning tasks such as Text-to-SQL.
State-of-the-art Text-to-SQL systems are typically multi-agent pipelines centered around two fundamental tasks: schema linking and SQL generation. However, existing work trains separate models for eac...
HarnessSQL introduces a harness‑native post‑training framework that keeps the full stateful, multi‑turn interaction structure of real‑world database agents during both supervised fine‑tuning and reinforcement learning. By building isolated executable database environments with hidden execution oracles and retaining only verified trajectories for full‑sequence SFT, the method enables execution‑reward RL that aligns training with inference. Experiments on Spider 2.0‑SQLite show dramatic gains in execution accuracy for compact models, and the approach transfers effectively to out‑of‑distribution interactive benchmarks such as BIRD‑Interact and LiveSQLBench.
LIMIT (Less Is More for Instruction Tuning in Text-to-SQL) challenges the belief that large instruction corpora are necessary for effective Text-to-SQL models. The framework uses a four‑stage data‑centric process—difficulty‑aware filtering, chain‑of‑thought synthesis, LLM‑as‑judge quality scoring, and genetic algorithm optimization—to select a compact set of examples that still achieve full schema coverage. On the BIRD and Spider benchmarks, LIMIT’s 796 and 863 samples enable Qwen3‑8B to reach 69.1% and 88.9% execution accuracy, outperforming methods trained on twenty times more data and setting a new state‑of‑the‑art for open‑source approaches.
arXiv:2609.20842v1 Announce Type: new Abstract: Text-to-SQL translates natural-language questions into executable SQL queries, but open-source large language models still require task-specific post-t...