arXiv:2607.28225v2 Announce Type: replace
Abstract: Agentic vision-language models (VLMs), which interleave textual reasoning with explicit tool calls such as cropping and code-based image manipulati...
By Haoqing Wang, Xingrun Xing, Ziheng Li, Jianyuan Guo, Yehui Tang
arXiv:2606. 30185v1 Announce Type: new Abstract: Improving vision-language models (VLMs) on visual reasoning typically requires retraining or hand-designed prompts and tools.
By Yutao Sun, Yanting Miao, Hao-Xuan Ma, Mengyu Zhou, Mingshuai Chen, Tiancheng Zhao, Dexin Wang, Lei Lv, Li Xu, Xiaoxi Jiang, Guanjun Jiang
arXiv:2512. 03438v3 Announce Type: replace Abstract: Agentic reasoning models trained with multimodal reinforcement learning (MMRL) have become increasingly capable, yet they are almost universally optimized using sparse, outcome-based rewards computed based on the final answers.
By Reuben Tan, Baolin Peng, Zhengyuan Yang, Hao Cheng, Oier Mees, Theodore Zhao, Andrea Tupini, Isar Meijer, Qianhui Wu, Yuncong Yang, Lars Liden, Yu Gu, Sheng Zhang, Xiaodong Liu, Lijuan Wang, Marc Pollefeys, Yong Jae Lee, Jianfeng Gao
arXiv:2608.29374v1 Announce Type: new
Abstract: Tool-augmented multimodal reasoning integrates external tools (e.g., object detection, depth estimation) into multimodal large language models (MLLMs)...
By Yu Cheng, Arushi Goel, Hakan Bilen
Improving vision-language models (VLMs) on visual reasoning typically requires retraining or hand-designed prompts and tools. We present Dynamo, a training-free framework that adapts a frozen VLM without any weight updates.
The paper examines whether tool-augmented multimodal agents truly gain capability from using tools. By comparing agents Thyme and DeepEyesV2 with tool-free and pure-text counterparts across tasks such as image understanding, OCR, chart reading, and math reasoning, the authors find that tool access offers little consistent improvement and that most problems solved with tools are also solvable without them. Ablation studies reveal that the full tool-use loop does not consistently outperform simpler tool-call or result-only formats, indicating that agents may learn tool-calling patterns rather than tool-contributed capabilities.
By Jiawei Guo, Donglei Yu, Yu Chen, Xiang Wang, Shuai Li, Xinpei Zhao, Huaxing Liu, Qinghao Wang, Minpeng Liao