arXiv AI
Sep 23

LIMIT: Less Is More for Instruction Tuning in Text-to-SQL

LIMIT (Less Is More for Instruction Tuning in Text-to-SQL) challenges the belief that large instruction corpora are necessary for effective Text-to-SQL models. The framework uses a four‑stage data‑centric process—difficulty‑aware filtering, chain‑of‑thought synthesis, LLM‑as‑judge quality scoring, and genetic algorithm optimization—to select a compact set of examples that still achieve full schema coverage. On the BIRD and Spider benchmarks, LIMIT’s 796 and 863 samples enable Qwen3‑8B to reach 69.1% and 88.9% execution accuracy, outperforming methods trained on twenty times more data and setting a new state‑of‑the‑art for open‑source approaches.

By Haoyuan Ma, Hengwei Liu, Linjuan Wu, Yongliang Shen, Weiming Lu
arXiv AI
Sep 17

DualSQL: Text-to-SQL with Multi-Agent Reinforcement Learning

DualSQL is a Text-to-SQL system that uses two agents sharing a single model backbone, enabling joint optimization via multi-agent reinforcement learning. The approach incorporates three database access tools for multi-step reasoning, rollout guardrails to stabilize training, and a new SQL correctness metric called robust execution match (REX). Trained on only 3,755 examples, DualSQL-4B reaches 68.0% execution accuracy on the BIRD dev set, while DualSQL-8B achieves 71.1%, surpassing prior state‑of‑the‑art single‑model solutions with 32B parameters.

By Shijie Chen, Yu Gan, Yeounoh Chung, Jiani Zhang, Quannan Li, Sravan Babu Bodapati, Cody J. Greer, Yu Su, Fatma Ozcan
arXiv AI
4d ago

VCoT-SQL: Enhancing Text-to-SQL Generation through Dual Chain-of-Thought Validation Training

VCoT‑SQL is a framework that improves text‑to‑SQL generation by training two complementary models on curated reasoning traces. It uses clause‑level chain‑of‑thought templates verified through execution and schema alignment, and a validator that detects syntactic, semantic, and type errors. The approach achieves high execution accuracy on BIRD and Spider datasets, outperforming larger closed‑source models while relying only on 7B open‑source models.

By Rui Zhang, Yujia Su, Ruixuan Li, Yuhua Li, Yixin Su