State-of-the-art Text-to-SQL systems are typically multi-agent pipelines centered around two fundamental tasks: schema linking and SQL generation. However, existing work trains separate models for eac...
HarnessSQL introduces a harness‑native post‑training framework that keeps the full stateful, multi‑turn interaction structure of real‑world database agents during both supervised fine‑tuning and reinforcement learning. By building isolated executable database environments with hidden execution oracles and retaining only verified trajectories for full‑sequence SFT, the method enables execution‑reward RL that aligns training with inference. Experiments on Spider 2.0‑SQLite show dramatic gains in execution accuracy for compact models, and the approach transfers effectively to out‑of‑distribution interactive benchmarks such as BIRD‑Interact and LiveSQLBench.
By Haolin Yang, Jipeng Zhang, Jian Xie, Shuaishuai Gong, Sirui Han, Yike Guo
SERL‑SQL introduces a selective execution‑grounded reinforcement learning framework for multi‑turn Text‑to‑SQL agents. It samples on‑policy interaction trajectories and employs a training‑only teacher to re‑score student actions using execution feedback, converting the teacher‑student likelihood gap into bounded, masked weights that reweight GRPO advantages only on SQL and tool‑action tokens. Experiments on BIRD, Spider, and cross‑domain benchmarks show competitive performance, achieving 76.56% execution accuracy on BIRD‑Dev and 89.92% on Spider‑Test, and the reward‑based selection strategy approaches the oracle Best‑of‑N upper bound.
By Tao Liu, Tao Feng, Xiangheng Li, Jinwang Song, Yifan Li, Xiaoqing Cheng, Dixuan Zhang, Siquan Li, Lin Lan, Hongying Zan, Kunli Zhang, Chao Wu
arXiv:2505. 04671v3 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) trained with reinforcement learning (RL) have improved Text-to-SQL performance.
By Yuxin Zhang, Meihao Fan, Ju Fan, Mingyang Yi, Yuyu Luo, Guoliang Li, Bin Wu, Wenchao Zhou
arXiv:2603.20004v4 Announce Type: replace-cross
Abstract: Translating natural language questions to SQL queries (Text-to-SQL) is a long-standing problem in database research. Recent efforts have focu...
By Yuxuan Zhu, Tengjun Jin, Yoojin Choi, Daniel Kang
BIRD‑RL is a new agentic reinforcement learning framework designed to scale training of small language models (SLMs) in data‑centric, stateful environments such as SQL debugging. It introduces a four‑stage curriculum that alternates between improving agent reasoning and trajectory‑adaptive exploration, and relies on a Trajectory‑scoped Persistent Execution Infrastructure to safely reuse database replicas while maintaining trajectory isolation. This approach yields a 12.8× improvement in spatial efficiency and enables 7B and 14B models to achieve competitive success rates on the BIRD‑CRITIC‑SQLite benchmark, matching proprietary agents like Claude‑Opus‑4.6.
By Ge Qu, Jinyang Li, Xiaohan Xu, Xiaolong Li, Bowen Qin, Nan Huo, Ziwei Tang, Chenhao Ma, Reynold Cheng
arXiv:2609.20842v1 Announce Type: new
Abstract: Text-to-SQL translates natural-language questions into executable SQL queries, but open-source large language models still require task-specific post-t...
By Qifeng Cai, Xuanguang Pan, Hao Liang, Chang Xu, Wentao Zhang
arXiv:2509. 06278v4 Announce Type: replace Abstract: Table reasoning requires models to jointly perform comprehensive semantic understanding and precise numerical operations.
By Chuang Jiang, Mingyue Cheng, Xiaoyu Tao, Qingyang Mao, Jie Ouyang, Qi Liu
arXiv:2606. 06825v1 Announce Type: cross Abstract: Reinforcement learning has recently shown promise in improving large language models for Text-to-SQL generation, yet existing methods typically optimize one-shot rewards defined over a single SQL state.
By Shihao Zhang, Xiaoman Wang, Yuan Liu, Yunshi Lan, Weining Qian
TRUST‑SQL tackles Text‑to‑SQL parsing in environments where the full database schema is unknown, a common scenario in enterprise settings with many noisy tables. The method models the problem as a Partially Observable Markov Decision Process and uses a four‑phase protocol to verify only relevant metadata, guided by a Dual‑Track GRPO strategy that separates exploration from execution rewards. Experiments on five benchmarks show significant gains, with the 4B and 8B variants outperforming base models by 30.6% and 16.6% respectively, while matching or exceeding baselines that rely on pre‑loaded schemas.
By Ai Jian, Xiaoyun Zhang, Eryu Guo, Wanrou Du, Jingqing Ruan, Jiangbo Pei, Weipeng Zhang, Ke Zeng, Xunliang Cai
arXiv:2601. 05451v2 Announce Type: replace Abstract: Recent advances in text-to-SQL have been driven by larger models, better datasets, and new training methods like RLVR.
By Marko Sterbentz, Kevin Cushing, Cameron Barrie, Kristian J. Hammond
UnifiedPlayers is a cooperative framework that jointly adapts planning, execution, and evaluation for tool-integrated reinforcement learning agents. It consists of a Planning Player that generates tasks, an Execution Player that creates multi-turn trajectories with Python tool calls, and an Evaluation Player that builds executable verifiers, all coordinated by role‑specific rewards under GRPO. The approach outperforms prior baselines on mathematical and general reasoning benchmarks and yields a verifier with high adversarial detection accuracy and more discriminative reward signals.
By Wenjie Liao, Liangjie Zhao, Zehong Cao