arXiv AI
Oct 12

CLEAT: Learning Value-Guided Clarification for Interactive Agents

CLEAT (CLarification through valuE-guided Agent co-Training) is a framework that jointly trains a clarification-value controller and a task policy to improve interactive intent alignment in large language model agents. It introduces a residual query value metric, estimated via paired rollouts, to assess the utility of asking clarification questions and uses this to guide both controller predictions and policy decisions. Experiments with Qwen3-4B show CLEAT outperforming baselines across multiple benchmarks, with significant gains in user‑centric tasks and demonstrating that co‑training benefits the task policy even when the controller is omitted at inference.

By Jiatan Huang, Zheyuan Zhang, Ziming Li, Tianyi Ma, Mingchen Li, Yanfang Ye, Chuxu Zhang
arXiv AI
Nov 5

When to Ask, When to Answer: Strategic Clarification for Ambiguous Reference Resolution in Dialogue

The paper investigates strategic clarification in dialogue, focusing on when large language models should ask clarification questions versus providing immediate answers to resolve ambiguous references. Using a controlled test environment derived from the SIMMC 2.1 dataset, the authors evaluate baseline LLM behavior and post‑training methods, noting a bias toward premature answering. They introduce BACE, a lightweight belief‑aware critic that tracks epistemic uncertainty, and demonstrate that it more consistently selects the optimal number of clarifying questions compared to methods like GRPO and ArCHer.

By Ibrahim Khebour, Nikhil Krishnaswamy
arXiv Computation and Language
Nov 4

Don't Guess, Ask Wisely: Benchmarking and Training Proactive Elicitation in Open-Domain LLM Conversations

The paper introduces VagueBench, a benchmark that degrades seed queries into vague variants to evaluate large language models’ ability to ask follow‑up questions when user queries are incomplete. It proposes DialogGRPO, an offline reinforcement learning approach that models multi‑turn elicitation as a dialogue‑state directed acyclic graph, using dense turn‑level rewards to guide question selection. DialogGRPO achieves over 88% success in eliciting missing information on vague queries, improves answer coverage and recovery efficiency, and outperforms prompting and test‑time scaling baselines while generalizing zero‑shot to other dialogue datasets.

By Rongyu Zhang, Mutian Bao, Jinjian Zhang, Yuetian Du, He Xu, Wei Zhou, Xiaojun Zhu, Ming Kong, Jie Liu, Linjian Mo, Qiang Zhu
arXiv AI
Aug 20

From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoning

The paper introduces VAKE, a two‑stage reinforcement‑learning framework that activates latent factual knowledge in large language models. In the Priming stage, the model explicitly inserts bridging triples into an insufficient subgraph, guided by rewards from a frozen model’s answers. The Reasoning stage then trains the model to answer from the original input, demonstrating that the elicitation capability transfers to implicit reasoning and consistently outperforms baselines across multiple benchmarks and model sizes.

By Zuocheng Ying, Yang Yang, Yumou Wu, Chuanbo Zhu, Jiarui Wang, Ziqi Wu, Jingming Cai, Junqing Yu, Zikai Song