AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,805 stories · RSS feed

arXiv AI
Aug 24

Share the Judge, Learn the Deferral: Where Specialization Helps LLM Evaluation

The paper investigates two strategies for improving large language model (LLM) evaluation: specialized judge weights and rule‑based deferral policies. Experiments on nearly 100,000 rubric‑conditioned samples show that correct rubrics boost accuracy, while incorrect ones hurt it, and that splitting training data into criterion‑specific experts can severely degrade performance unless the experts are warm‑started from a unified model. The authors demonstrate that lightweight deferral cascades can match or exceed the accuracy of larger standalone judges at a fraction of the compute cost, and they provide practical design rules for building efficient, reliable LLM evaluators.

By Ye Chen, Weining Zhang
arXiv AI
Aug 24

Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning

The paper introduces a method to improve test-time scaling (TTS) for large language models by using multi-agent systems (MAS) to split long reasoning chains into manageable contexts. A new dataset, M500, containing 500 multi-agent collaborative reasoning traces, is used to fine‑tune open‑source models, enabling them to learn collaborative patterns and outperform their base versions. An adaptive scaling strategy with a "CEO" agent is proposed to dynamically guide reasoning depth, and experiments in the AgentVerse framework confirm the effectiveness of the approach.

By Can Jin, Hongwu Peng, Qixin Zhang, Yujin Tang, Dimitris N. Metaxas, Tong Che
arXiv Computation and Language
Aug 24

Tree-of-Experience: Hierarchical Experience Management for Self-Evolving Agents

Tree-of-Experience (ToE) is a hierarchical experience-management framework designed for large language model agents that aligns stored experiences with the agents’ reasoning hierarchy. By organizing experiences into a shared tree of analytical perspectives and reasoning paths, ToE calibrates reliability through environmental outcomes, enabling systematic updating, cross-task transfer, and efficient retrieval. Experiments on Game of 24 and FinEvolveBench demonstrate that ToE yields significant performance gains—31.4% accuracy improvement on Game of 24 and a 41.24% average improvement in tsIC on FinEvolveBench—outperforming both experience-free baselines and conventional experience-management methods.

By Zihao Deng, Yining Zhu, Leiming Wang, Junbo Wang, Jingfei Lu
arXiv Machine Learning
Aug 24

BIPPO: Budget-Aware Independent PPO for Energy-Efficient Federated Learning Services

BIPPO (Budget-aware Independent Proximal Policy Optimization) is a multi‑agent reinforcement learning framework designed for energy‑efficient client selection in federated learning (FL) over IoT systems. It addresses infrastructure constraints such as limited resources and device churn, which traditional FL and RL approaches overlook. Evaluated on two image‑classification tasks with non‑IID data, BIPPO improves mean accuracy over non‑RL methods, standard PPO, and IPPO while consuming only a negligible portion of the budget, even as client numbers grow.

By Anna Lackinger, Andrea Morichetta, Pantelis A. Frangoudis, Schahram Dustdar
Towards Data Science
Aug 22

Building a Proper Backend for My LangGraph AI Agent

The article discusses transforming a demo LangGraph AI agent into a fully functional backend capable of handling real booking data. It outlines the steps and considerations involved in building a robust system that supports live data processing and integration. The focus is on practical implementation details rather than theoretical concepts.

By Soner Yıldırım
Simon Willison
Aug 22

More than just code review

The article discusses the essential skill of effectively instructing coding agents and verifying their changes. It highlights that while line‑by‑line code review is one method, it is not the most efficient way to validate software changes. The focus is on confidently guiding agents and confirming correct implementation without exhaustive inspection.