arXiv AI

Rethinking the Role of Tool Graph Memory in Multi-Turn Tool Use

The paper investigates the effectiveness of tool graph memory—a component that records past tool transitions to guide future tool selection—in large language model agents performing multi‑turn tasks. Across nine models and two benchmarks, the authors find that tool graph memory rarely yields significant performance gains, often incurs more than twice the number of LLM calls, and its guidance is frequently incorrect. They observe that random or no guidance can achieve similar improvements, suggesting the benefits arise from additional computation rather than the memory itself, and that storing experiences as textual insights outperforms the graph approach with minimal extra calls.

arXiv Machine Learning
Sep 24

Learning from Failures: Heterogeneous Graph Memory for Small Language Model Tool-Using Agents

The paper introduces FRESH, a Failure-aware Retrieval framework that uses Experience-Structured Heterogeneous graphs to transform past successes and failures into structured external memory for tool‑using agents. By explicitly modeling dependencies among tasks, actions, errors, repairs, and execution conditions, FRESH enables frozen language models to reuse reliable strategies, avoid recurring failures, and make safer decisions in stateful tool interactions. Experiments on τ‑Bench and AppWorld with multiple open‑source models demonstrate that FRESH consistently improves task success and tool‑use reliability compared to no‑memory agents and other memory‑based baselines.

By Jiaxing Li, Lei Song, Rui Dong, Youyong Kong
arXiv Computation and Language
Oct 28

TrawMem: Reframing Agent Memory as Task-Oriented Role-Adaptive Workspaces

TrawMem redefines agent memory systems as Task‑Oriented Role‑Adaptive Workspaces, selecting and organizing memories by their roles in task solving rather than mere relevance. It structures interaction histories into local threads and jointly selects complementary memories to build task‑specific workspaces. Experiments on LoCoMo and MemGallery show consistent macro‑F1 gains of 2.23–3.14 points and improved LLM‑Judge scores with fewer context tokens.

By Mingyu Zhang, Zixu Li, Zhiheng Fu, Zhiwei Chen, Jinhe Bi, Yupeng Hu
arXiv AI
Sep 3

UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agents

UniToolCall introduces a unified framework for tool-use in large language model agents, standardizing toolset construction, dataset generation, and evaluation. The framework aggregates over 22,000 tools and creates a hybrid training corpus of more than 390,000 instances by combining ten public datasets with synthetically generated, structurally controlled trajectories. It models diverse interaction patterns—single‑hop vs. multi‑hop, single‑turn vs. multi‑turn, serial vs. parallel execution—and adds an Anchor Linkage mechanism to enforce cross‑turn dependencies, while converting seven public benchmarks into a common Query–Action–Observation–Answer format for fine‑grained evaluation.

By Yijuan Liang, Xinghao Chen, Yifan Ge, Ziyi Wu, Hao Wu, Changyu Zeng, Wei Xing, Xiaoyu Shen
arXiv AI
2d ago

Graph-Mediated Large Language Model Systems in the Agentic Era: Reasoning, Knowledge, Retrieval, Execution, and Coordination

The paper surveys how graphs are increasingly used in large language model systems to support reasoning, knowledge grounding, retrieval, memory, execution, and multi‑agent coordination. It introduces an operation‑level taxonomy that distinguishes the function of each graph operation, the component that computes it, and how its output is subsequently used. The authors compare graph observations with external computations, analyze memory updates, and examine execution dependencies, then propose an evaluation framework that organizes benchmarks, diagnostics, and system costs, concluding with open challenges in adaptive computation, memory maintenance, and dependency‑aware recovery.

By Haihui Liu, Yang Chen, Zice Qiu, Yun Zhang, Jialun Zhong, Wenhua Wang, Yanzeng Li, Tian Wang
arXiv AI
Sep 3

Harness Engineering in LLM Tool Use via Agent-Native Reusable Tool Primitives

The paper introduces Tool Primitives, a design that replaces rigid API schemas with natural language interfaces for tool calling, enabling seamless inter-tool communication. It builds ToolFace, a repository of over 25,000 functions that LLMs can dynamically retrieve, and HEART, a harness engineering framework that orchestrates tool use with planning, routing, and verification. Experiments show HEART outperforms fine‑tuned models and leading commercial LLMs while cutting API costs by up to 85%.

By Haibo Jin, Suijin Wang, Xucheng Yu, Haojing Luo, Haohan Wang