Hugging Face Trending Papers

Training Small Language Models for Transferable Tool Selection

Read the original on Hugging Face Trending Papers →

The paper presents a method for training small language models to select appropriate tools for complex, multi-step user instructions, addressing the challenge of handling large tool corpora. By using reinforcement learning, a Qwen3-8B model is trained to perform tool selection, achieving performance that surpasses a 402‑billion‑parameter Llama‑4‑Maverick model on the ToolBench benchmark. The trained model also demonstrates transferability to different retrievers and generalization across new tool domains.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Machine Learning
Oct 23

Training Small Language Models for Transferable Tool Selection

The paper presents a method for training a small, open-source language model to select appropriate tools from large tool corpora, addressing the bottleneck of tool selection for LLM agents. By using reinforcement learning, the authors demonstrate that a Qwen3-8B model can outperform a much larger Llama-4-Maverick model on the ToolBench benchmark. The trained model also transfers to different retrievers and generalizes to new tool domains.

By Zhaoyi Zhou, Akshayaa Magesh, Jeongyeol Kwon, Artem Kuriksha, Daniel Jiang, Andrea Zanette, Ayush Jain
Hugging Face Trending Papers
Aug 11

SKILLER: Language-Level Reinforcement Learning for Reusable Skill Extraction in Small Language Models

Agent skills represent a standardized format for packaging procedural knowledge and domain expertise, serving within agent harness systems as an essential mechanism to continually constrain a language model's behavior space for repeatable, high-quality task execution. However, because strong closed-source models entail high inference costs, current popular agent harnesses, such as Codex and OpenClaw, remain prohibitively expensive when deploying these skills to accomplish real-world tasks.

arXiv AI
Aug 12

SKILLER: Language-Level Reinforcement Learning for Reusable Skill Extraction in Small Language Models

arXiv:2608. 10538v1 Announce Type: new Abstract: Agent skills represent a standardized format for packaging procedural knowledge and domain expertise, serving within agent harness systems as an essential mechanism to continually constrain a language model's behavior space for repeatable, high-quality task execution.

By Chenhao Dang, Siyuan Xiong, Conghui He, Weijia Li