arXiv Machine Learning July 30, 2026 By Yicheng Feng, Yan Zhang, Yan Cheng, Wei Qi

Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents

Read the original on arXiv Machine Learning →

arXiv:2607. 27083v1 Announce Type: new Abstract: As LLM agents increasingly depend on diverse external services such as search engines, databases, and connectors, agent harnesses face a fundamental tool-selection challenge: acquiring too few tools leaves the task under-informed, while too many adds cost, context load, and privacy exposure.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 9

How Many Tools Should an LLM Agent See? A Chance-Corrected Answer

arXiv:2605. 24660v2 Announce Type: replace-cross Abstract: Before an LLM agent can use a tool, a retrieval system must decide which candidate tools to show to the agent.

By Vyzantinos Repantis, Ameya Gawde, Harshvardhan Singh, Joey Blackwell II

llms agents reinforcement-learning benchmarks

arXiv Machine Learning

Sep 22

Toollery: Scaling LLM Agents to Thousands of Skills and Tools

Toollery is a training‑free framework that compresses candidate lists for large language model agents, enabling efficient selection from thousands of skills and tools. It generates user‑intent queries from each skill or tool specification, builds a retrieval index, and limits online selection to a compact top‑k set before the LLM makes its final decision. Evaluations on the SkillRouter benchmark, BFCL‑V4, and a proprietary smart‑cockpit dataset show that Toollery improves recall and end‑to‑end selection while keeping selection costs bounded.

By Xiangxi Tian, Ran Guan

llms agents benchmarks

arXiv AI

3d ago

Lookahead-R: Budget-Aware Tool Retrieval via Execution-Centric Planning

arXiv:2609.35811v1 Announce Type: cross Abstract: Tool retrieval is a critical bottleneck for LLM-based agents operating over large, heterogeneous API ecosystems. Existing approaches face an inherent...

By Zongze Wu, Yani Guo, Runnan Li

llms agents benchmarks

arXiv AI

Aug 11

From Relevance to Execution Utility: Reward-Aware Dynamic Execution Gating for Skill-Based LLM Agents

arXiv:2608. 09168v1 Announce Type: new Abstract: Agent skills are increasingly used to equip large language model (LLM) agents with reusable procedural knowledge.

By Liang He, Jingbo Wen, Hongyu Gu, Hao Li, Haoyu Wang, Yixiong Chen, Kangning Cui, Xilu Wang

llms agents

arXiv AI

Jun 8

To Call or Not to Call: A Framework to Assess and Optimize LLM Tool Calling

arXiv:2605. 00737v2 Announce Type: replace Abstract: Agentic AI architectures augment LLMs with external tools, unlocking strong capabilities.

By Qinyuan Wu, Soumi Das, Mahsa Amani, Arijit Nag, Seungeon Lee, Krishna P. Gummadi, Abhilasha Ravichander, Muhammad Bilal Zafar

llms agents

arXiv Machine Learning

Jun 11

Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks

arXiv:2606. 12344v1 Announce Type: new Abstract: General-purpose agents such as OpenClaw are increasingly used as autonomous tool users, but their coding ability is difficult to measure under SWE-bench: a generic agent does not by itself satisfy the clean Docker workspace, patch, and prediction contract required for scoring.

By Mengyu Zheng, Kai Han, Boxun Li, Haiyang Xu, Yuchuan Tian, Wei He, Hang Zhou, Jianyuan Guo, Hailin Hu, Lin Ma, Chao Xu, Guohao Dai, Lixue Xia, Yunchao Wei, Yunhe Wang, Yu Wang

agents benchmarks

One email a morning, machine-written

Related stories

How Many Tools Should an LLM Agent See? A Chance-Corrected Answer

Toollery: Scaling LLM Agents to Thousands of Skills and Tools

Lookahead-R: Budget-Aware Tool Retrieval via Execution-Centric Planning

From Relevance to Execution Utility: Reward-Aware Dynamic Execution Gating for Skill-Based LLM Agents

To Call or Not to Call: A Framework to Assess and Optimize LLM Tool Calling

Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks