Clarify or Answer: Reinforcement Learning for Agentic VQA with Context Under-specification
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
arXiv:2606. 29984v1 Announce Type: new Abstract: Reinforcement Learning (RL) is an important paradigm for improving the reasoning capabilities of Vision-Language Models (VLMs).
arXiv:2606. 13929v1 Announce Type: cross Abstract: Vision-language models (VLMs) are typically trained as passive answerers, while their ability to actively ask diverse, non-trivial, visual-centric and grounded questions remains underexplored.
CLEAT (CLarification through valuE-guided Agent co-Training) is a framework that jointly trains a clarification-value controller and a task policy to improve interactive intent alignment in large language model agents. It introduces a residual query value metric, estimated via paired rollouts, to assess the utility of asking clarification questions and uses this to guide both controller predictions and policy decisions. Experiments with Qwen3-4B show CLEAT outperforming baselines across multiple benchmarks, with significant gains in user‑centric tasks and demonstrating that co‑training benefits the task policy even when the controller is omitted at inference.
arXiv:2604.07146v3 Announce Type: replace Abstract: Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for...
arXiv:2609.35942v1 Announce Type: new Abstract: Recent work in visual question answering has shown that vision-language models can exhibit strong reasoning capabilities by translating visual inputs i...
arXiv:2609.24290v1 Announce Type: new Abstract: Instruction-tuned LLMs faced with underspecified queries often commit to a single interpretation rather than ask for clarification, producing confident...