Hugging Face Trending Papers

DualSQL: Text-to-SQL with Multi-Agent Reinforcement Learning

arXiv AI
Sep 17

DualSQL: Text-to-SQL with Multi-Agent Reinforcement Learning

DualSQL is a Text-to-SQL system that uses two agents sharing a single model backbone, enabling joint optimization via multi-agent reinforcement learning. The approach incorporates three database access tools for multi-step reasoning, rollout guardrails to stabilize training, and a new SQL correctness metric called robust execution match (REX). Trained on only 3,755 examples, DualSQL-4B reaches 68.0% execution accuracy on the BIRD dev set, while DualSQL-8B achieves 71.1%, surpassing prior state‑of‑the‑art single‑model solutions with 32B parameters.

By Shijie Chen, Yu Gan, Yeounoh Chung, Jiani Zhang, Quannan Li, Sravan Babu Bodapati, Cody J. Greer, Yu Su, Fatma Ozcan
arXiv Computation and Language
Oct 9

HarnessSQL: Harness-Native Training for SQL Agents in Realistic Database Environments

HarnessSQL introduces a harness‑native post‑training framework that keeps the full stateful, multi‑turn interaction structure of real‑world database agents during both supervised fine‑tuning and reinforcement learning. By building isolated executable database environments with hidden execution oracles and retaining only verified trajectories for full‑sequence SFT, the method enables execution‑reward RL that aligns training with inference. Experiments on Spider 2.0‑SQLite show dramatic gains in execution accuracy for compact models, and the approach transfers effectively to out‑of‑distribution interactive benchmarks such as BIRD‑Interact and LiveSQLBench.

By Haolin Yang, Jipeng Zhang, Jian Xie, Shuaishuai Gong, Sirui Han, Yike Guo
arXiv Computation and Language
Oct 9

SERL-SQL: Selective Hindsight Distillation for Text-to-SQL Reinforcement Agentic Learning

SERL‑SQL introduces a selective execution‑grounded reinforcement learning framework for multi‑turn Text‑to‑SQL agents. It samples on‑policy interaction trajectories and employs a training‑only teacher to re‑score student actions using execution feedback, converting the teacher‑student likelihood gap into bounded, masked weights that reweight GRPO advantages only on SQL and tool‑action tokens. Experiments on BIRD, Spider, and cross‑domain benchmarks show competitive performance, achieving 76.56% execution accuracy on BIRD‑Dev and 89.92% on Spider‑Test, and the reward‑based selection strategy approaches the oracle Best‑of‑N upper bound.

By Tao Liu, Tao Feng, Xiangheng Li, Jinwang Song, Yifan Li, Xiaoqing Cheng, Dixuan Zhang, Siquan Li, Lin Lan, Hongying Zan, Kunli Zhang, Chao Wu
arXiv Machine Learning
Oct 22

BIRD-RL: Scaling Agentic Reinforcement Learning over Stateful Data-Centric Environments

BIRD‑RL is a new agentic reinforcement learning framework designed to scale training of small language models (SLMs) in data‑centric, stateful environments such as SQL debugging. It introduces a four‑stage curriculum that alternates between improving agent reasoning and trajectory‑adaptive exploration, and relies on a Trajectory‑scoped Persistent Execution Infrastructure to safely reuse database replicas while maintaining trajectory isolation. This approach yields a 12.8× improvement in spatial efficiency and enables 7B and 14B models to achieve competitive success rates on the BIRD‑CRITIC‑SQLite benchmark, matching proprietary agents like Claude‑Opus‑4.6.

By Ge Qu, Jinyang Li, Xiaohan Xu, Xiaolong Li, Bowen Qin, Nan Huo, Ziwei Tang, Chenhao Ma, Reynold Cheng
arXiv AI
Sep 12

TRUST-SQL: Tool-Integrated Multi-Turn Reinforcement Learning for Text-to-SQL over Unknown Schemas

TRUST‑SQL tackles Text‑to‑SQL parsing in environments where the full database schema is unknown, a common scenario in enterprise settings with many noisy tables. The method models the problem as a Partially Observable Markov Decision Process and uses a four‑phase protocol to verify only relevant metadata, guided by a Dual‑Track GRPO strategy that separates exploration from execution rewards. Experiments on five benchmarks show significant gains, with the 4B and 8B variants outperforming base models by 30.6% and 16.6% respectively, while matching or exceeding baselines that rely on pre‑loaded schemas.

By Ai Jian, Xiaoyun Zhang, Eryu Guo, Wanrou Du, Jingqing Ruan, Jiangbo Pei, Weipeng Zhang, Ke Zeng, Xunliang Cai
arXiv AI
Jun 30

Pushing Forward Pareto Frontiers of Proactive Agents with Behavioral Agentic Optimization

arXiv:2602. 11351v2 Announce Type: replace Abstract: Proactive large language model (LLM) agents aim to actively plan, query, and interact over multiple turns, enabling efficient task completion beyond passive instruction following and making them essential for real-world, user-centric applications.

By Yihang Yao, Zhepeng Cen, Haohong Lin, Shiqi Liu, Zuxin Liu, Jiacheng Zhu, Zhang-Wei Hong, Laixi Shi, Ding Zhao