Hugging Face Trending Papers
DualSQL: Text-to-SQL with Multi-Agent Reinforcement Learning
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
Sep 17
DualSQL: Text-to-SQL with Multi-Agent Reinforcement Learning
DualSQL is a Text-to-SQL system that uses two agents sharing a single model backbone, enabling joint optimization via multi-agent reinforcement learning. The approach incorporates three database access tools for multi-step reasoning, rollout guardrails to stabilize training, and a new SQL correctness metric called robust execution match (REX). Trained on only 3,755 examples, DualSQL-4B reaches 68.0% execution accuracy on the BIRD dev set, while DualSQL-8B achieves 71.1%, surpassing prior state‑of‑the‑art single‑model solutions with 32B parameters.
arXiv Computation and Language
Oct 9
HarnessSQL: Harness-Native Training for SQL Agents in Realistic Database Environments
HarnessSQL introduces a harness‑native post‑training framework that keeps the full stateful, multi‑turn interaction structure of real‑world database agents during both supervised fine‑tuning and reinforcement learning. By building isolated executable database environments with hidden execution oracles and retaining only verified trajectories for full‑sequence SFT, the method enables execution‑reward RL that aligns training with inference. Experiments on Spider 2.0‑SQLite show dramatic gains in execution accuracy for compact models, and the approach transfers effectively to out‑of‑distribution interactive benchmarks such as BIRD‑Interact and LiveSQLBench.
arXiv Machine Learning
Jun 15
Reward-SQL: Boosting Text-to-SQL via Stepwise Execution-Aware Reasoning and Process-Supervised Rewards
arXiv:2505. 04671v3 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) trained with reinforcement learning (RL) have improved Text-to-SQL performance.
arXiv Computation and Language
Aug 24
Human-Level Text-to-SQL via Reinforcement Learning on Verified Data, Without Pipeline Engineering
arXiv:2603.20004v4 Announce Type: replace-cross Abstract: Translating natural language questions to SQL queries (Text-to-SQL) is a long-standing problem in database research. Recent efforts have focu...
arXiv Computation and Language
Oct 9
SERL-SQL: Selective Hindsight Distillation for Text-to-SQL Reinforcement Agentic Learning
SERL‑SQL introduces a selective execution‑grounded reinforcement learning framework for multi‑turn Text‑to‑SQL agents. It samples on‑policy interaction trajectories and employs a training‑only teacher to re‑score student actions using execution feedback, converting the teacher‑student likelihood gap into bounded, masked weights that reweight GRPO advantages only on SQL and tool‑action tokens. Experiments on BIRD, Spider, and cross‑domain benchmarks show competitive performance, achieving 76.56% execution accuracy on BIRD‑Dev and 89.92% on Spider‑Test, and the reward‑based selection strategy approaches the oracle Best‑of‑N upper bound.
arXiv Machine Learning
Oct 22
BIRD-RL: Scaling Agentic Reinforcement Learning over Stateful Data-Centric Environments
BIRD‑RL is a new agentic reinforcement learning framework designed to scale training of small language models (SLMs) in data‑centric, stateful environments such as SQL debugging. It introduces a four‑stage curriculum that alternates between improving agent reasoning and trajectory‑adaptive exploration, and relies on a Trajectory‑scoped Persistent Execution Infrastructure to safely reuse database replicas while maintaining trajectory isolation. This approach yields a 12.8× improvement in spatial efficiency and enables 7B and 14B models to achieve competitive success rates on the BIRD‑CRITIC‑SQLite benchmark, matching proprietary agents like Claude‑Opus‑4.6.