arXiv AI
When Should a VLM Look? Paying Only for Visual Calls That Were Needed and Used
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
2d ago
Visual sensitivity is not claim retractability: persistence-aware credit assignment for multimodal reinforcement learning
arXiv:2609.36572v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has been extended to Large Vision-Language Models (LVLMs), and perception-aware methods further e...
arXiv Machine Learning
Sep 24
ProCredit: From Outcome Rewards to Progress Credit in Agentic Reinforcement Learning
arXiv:2609.27532v1 Announce Type: new Abstract: Long-horizon agentic tasks require an agent to modify an environment through a sequence of tool calls, with success determined by the final state. The...
arXiv AI
Jun 16
Looking Is Not Picking: An Attention-Segment Account of Tool-Selection Failures in LLM Agents
arXiv:2606. 16364v1 Announce Type: new Abstract: LLM agents mis-call tools, and the natural guess is that the model failed to see the right tool in a crowded harness.
arXiv Machine Learning
Sep 15
GroundBench: A Factorized, Counterfactual Benchmark for Locating VLM Affordance Failures
arXiv:2609.13308v1 Announce Type: cross Abstract: A companion evaluation found that naming the target part in a manipulation prompt increased action accuracy by 0.32-0.63 across eight vision-language...
arXiv AI
Jun 9
Decision-Aware Memory Cards: Counterfactual-Inspired Context Selection and Compression for Tool-Using LLM Agents
arXiv:2606. 08151v1 Announce Type: new Abstract: Tool-using LLM agents often fail not because relevant text is absent, but because decisive evidence is not selected, compressed, or surfaced at action time.
arXiv AI
1d ago
Evaluating Agents Across Runtime Contracts: When Mismatch Costs Efficiency or Quality
arXiv:2603.01209v3 Announce Type: replace Abstract: In CodeAct, language-model agents write Python that calls tools and use execution feedback to choose actions. Persistent runtimes preserve Python v...