Users of language-based assistive agents often make ambiguous requests. In response, an assistant can either directly act on its interpretation of the request --- risking misalignment with the user --...
CLEAT (CLarification through valuE-guided Agent co-Training) is a framework that jointly trains a clarification-value controller and a task policy to improve interactive intent alignment in large language model agents. It introduces a residual query value metric, estimated via paired rollouts, to assess the utility of asking clarification questions and uses this to guide both controller predictions and policy decisions. Experiments with Qwen3-4B show CLEAT outperforming baselines across multiple benchmarks, with significant gains in user‑centric tasks and demonstrating that co‑training benefits the task policy even when the controller is omitted at inference.
By Jiatan Huang, Zheyuan Zhang, Ziming Li, Tianyi Ma, Mingchen Li, Yanfang Ye, Chuxu Zhang
arXiv:2609.37236v1 Announce Type: new
Abstract: An agent that uses tools typically responds to what the user explicitly asks, yet completing the task may require information the user never requested....
By Ido Levy, Asaf Yehudai, Segev Shlomov, Asaf Adi, Leshem Choshen
arXiv:2606. 03135v1 Announce Type: new Abstract: Large Language Model (LLM) agents often operate under underspecified user instructions, where latent uncertainty over user intent leads to erroneous tool actions.
By Mengyi Deng, Zhiwei Li, Xin Li, Tingyu Zhu, Ying Zhao, Zhijiang Guo, Wei Wang
An agent that uses tools typically responds to what the user explicitly asks, yet completing the task may require information the user never requested. Work on proactive agents mainly studies whether...
arXiv:2606. 11349v1 Announce Type: new Abstract: In hierarchical reasoning, failures often originate at intermediate decision points where the agent commits to a wrong branch without recognizing that it lacks critical information.
By Aijing Gao, Yiming Kang, Mengdie Flora Wang, Jae Oh Woo
The paper introduces PlanPool, a method for agentic Text-to-SQL systems to manage clarification questions by maintaining a mutable question pool. By requiring agents to explicitly ask or drop each planned question, PlanPool improves ambiguity coverage and reduces silent failures compared to unconstrained or prompt-based approaches. Experiments on benchmarks derived from BIRD-Interact and Spider show that PlanPool achieves competitive execution accuracy while better handling underspecification.
By Wen-Zhi Li, Yue Gong, Konstantinos Kanellis, Balakrishnan Murali Narayanaswamy
arXiv:2608.22266v1 Announce Type: new
Abstract: In the context of information seeking, conversational agents are undergoing an evolution from reactive tools to proactive, personalized assistants. A c...
By Zhihong Cao, Chen Huang
BASIS is a benchmark that tests large language model agents on their ability to infer users’ mental states, detect belief‑reality mismatches, and use this insight to craft better solutions in interactive settings. The study shows that current models often ignore users’ mental states, leading to poorer outcomes, while explicitly eliciting and incorporating such information improves solution quality. Additional experiments compare BASIS with Chain‑of‑Thought prompting, targeted training, and multi‑agent collaboration to demonstrate the practical benefits of mental‑state awareness.
By Minyuan Ruan, Ziyue Wang, Kaiming Liu, Yunghwei Lai, Peng Li, Yang Liu
The paper introduces Ask2Decide, a benchmark of 43 planning tasks designed to test whether large language model (LLM) agents can identify and request missing decision‑relevant information from humans. It collects 79 interaction sessions from 19 participants, showing that human replies often omit critical facts, and uses these data to calibrate a simulated operator. Evaluation of four state‑of‑the‑art LLMs reveals that their initial plans are infeasible on 58‑98% of tasks when information is missing, and that agents only slightly outperform random guessing in distinguishing useful from irrelevant facts.
By Yuhan Tang, Ke Fan, Xinkai Zou, Baichuan Mo, Kangxin Cui, Ao Qu, Ou Zheng, Jiangbo Yu, Haris N. Koutsopoulos, Jinhua Zhao, Yuan Zhou
arXiv:2607. 02686v1 Announce Type: new Abstract: Reinforcement learning agents operating under partial observability must act on incomplete information, making them natural candidates for guidance from small language models (SLMs) that carry broad reasoning priors.
By Juarez Monteiro, Nathan Gavenski, Guilherme Lima, Francisco Galuppo, Odinaldo Rodrigues, Adriano Veloso
arXiv:2512.04068v3 Announce Type: replace
Abstract: To handle underspecified or ambiguous queries, AI assistants need a policy for managing their uncertainty to determine (a) when to guess the user i...
By Jonathan Berant, Maximillian Chen, Adam Fisch, Reza Aghajani, Fantine Huot, Mirella Lapata, Jacob Eisenstein