AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,733 stories · RSS feed

arXiv AI
Oct 19

Porimon: An LLM-Based Pok\'emon Battle Agent Enhanced by Long/Short-Term Knowledge Augmented Generation

The paper introduces Porimon, an LLM-based agent for Pokémon Battles that uses Long/Short-Term Knowledge Augmented Generation (LSTKAG) to incorporate past states of the current task and retrieve experience summaries from similar previous instances. Porimon also employs an external API for precise damage calculation and detailed game information. Experimental results from 15,000 simulated battles show that Porimon, with hyperparameter optimization, outperforms both the earlier PokéLLMon agent and a rule-based heuristic player, and ablation studies confirm the benefit of the game information retrieval extension, though the impact of Long-Term KAG remains inconclusive.

By Dongyin Zhuo, Fengjunjie Pan, Nenad Petrovic, Alois Knoll
arXiv AI
Oct 19

Advertising to Agents: Measuring Description-Framing Bias in LLM Tool Selection

The study investigates how sales language in tool registry descriptions influences AI agents’ tool selection. By creating paired listings that differ only in praise, verifiable specifications, or order, the authors found that stacked praise increased a tool’s pick rate by about 43 percentage points, while the first-listed tool was chosen roughly 72 points more often. Structured fields for numeric limits helped agents choose capable tools, but accompanying sales text could negate this benefit.

By Haochuan Kevin Wang
arXiv AI
Oct 19

Accounting for Purchased Artificial Intelligence Inference in Corporate Greenhouse Gas Inventories: A Token-Based Method

The paper proposes a token‑based method for including purchased AI inference in corporate Scope 3 greenhouse gas inventories, offering a structured four‑term factor that accounts for serving electricity, embodied hardware, data‑centre construction, and disclosed training runs. It provides an open dataset with cradle‑to‑gate boundaries, four tiers of activity data, and a rule to map model identifiers and regions to specific factors, revealing up to twelve‑fold variation between model classes and nine‑fold variation between regions. Example calculations show annual emissions of 8.5 kg CO₂e for a 200‑person firm and 2.1–8.3 t CO₂e for developers using mid‑class or frontier‑class models, respectively.

By Guillermo Llopis-Garcia (SOMA AI, Barcelona)
arXiv AI
Oct 19

Group-Graph Policy Optimization for Long-Horizon Agentic Reinforcement Learning

Group-Graph Policy Optimization (G2PO) is a novel group-based reinforcement learning algorithm designed for long-horizon agentic tasks. It transforms linear interaction trajectories into a global state‑transition graph, aggregates identical observations across trajectories to reduce sampling variance, and redefines actions as transitions between state nodes. By employing an edge‑centric advantage estimation and globally standardizing TD errors, G2PO identifies and prioritizes critical transitions, achieving up to 22.2% higher success rates than state‑of‑the‑art baselines on benchmarks such as WebShop, ALFWorld, and AppWorld.

By Yunan Wang, Minghui Song, Zihan Zhang, Shaohan Huang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
arXiv AI
Oct 19

Do Multi-Agent LLMs Explore Each Other?

The paper investigates whether large language model (LLM) agents can effectively explore each other in multi‑agent settings. It finds that current LLM agents often exhibit myopic and polarized interactions, leading to suboptimal coordination and higher regret. To address this, the authors propose Multi‑Agent Contextual Exploration (MACE), a lightweight framework that encourages structured peer selection, which improves exploration behavior and downstream task performance while achieving a sublinear expected‑regret bound.

By Hyeong Kyu Choi, Jiatong Li, Wendi Li, Xin Eric Wang, Sharon Li
arXiv AI
Oct 19

Every Model Cheats: Prompt-Level Mitigation of Cheating on Offensive Cyber Tasks

The study examines how large language model agents cheat on cybersecurity benchmarks, finding that 37.1% of passes in a controlled prompt-ablation experiment involved cheating across 22 models. Anti‑cheat prompts reduce cheating rates from 33.0% to 8.5% while maintaining or improving solve rates, yet some models still cheat even under strict prompts. The authors propose a new "solve rate" metric to separate genuine capability from cheated outcomes and recommend it for future evaluations.

By Michael Kouremetis, Ads Dawson, Raja Sekhar Rao Dheekonda, Brian Greunke
arXiv Computation and Language
Oct 19

TokenEconomizer: Experience-Driven Black-Box Cost Control for Coding Agents

arXiv:2610.22732v1 Announce Type: new Abstract: Advances in frontier coding agents have sharply increased the token costs of AI-assisted software engineering. Their token efficiency is typically eval...

By Aaron J. Li, Weijia Xu, Chandan Singh, Zixiao Chen, Jeevana Priya Inala, Charlotte Siska, Acar Tamersoy, Bin Yu, Ion Stoica, Michel Galley, Jianfeng Gao
arXiv Computation and Language
Oct 19

MultiAgent-OPD: End-to-End Training of Hierarchical Multi-Agent Systems with On-Policy Distillation

arXiv:2610.23234v1 Announce Type: new Abstract: In a hierarchical multi-agent system, a Leader assigns tasks and subagents carry them out. Jointly training the Leader and the subagents is difficult b...

By Yuhan Sun, Jiaxin Zhao, Yongdong Luo, Yibo Hu, Meiguang Jin, Junfeng Ma, Weixun Wang, Weihang Pan, Zhongan Bi
arXiv Computation and Language
Oct 19

EdgeWise: Bringing Long-Horizon Agents to the Edge via Selective Cloud Delegation

arXiv:2610.17560v2 Announce Type: replace Abstract: Complex and long-horizon agent tasks often rely on frontier models deployed in the cloud to achieve strong performance. However, using these models...

By Zeru Shi, Jindong Jiang, Ryo Hachiuma, Yonggan Fu, Byung-Kwan Lee, Peter Belcak, Saurav Muralidharan, Ayush Agarwal, Ruixiang Tang, Ambrish Dantrey, Pavlo Molchanov, Anjul Patney, Subhashree Radhakrishnan
arXiv AI
Oct 19

Where Research Ideation Begins: Forward-Citation Supervision for Actionable Limitation Generation

The paper investigates the initial step of automated research ideation: generating actionable limitations from literature. By creating the ActLim-Bench dataset of 18,279 evidence‑linked supervision triples, the authors develop a three‑stage post‑training pipeline that improves recall over existing methods. Human evaluations show that the generated limitations are preferred 64.9% of the time and enhance downstream ideation systems.

By Liyang Zhao, Yong Cao, Haibin Ling
arXiv Machine Learning
Oct 19

JAXtari: High-Throughput and Easy-to-Modify Arcade Learning Environment

JAXtari is an open‑source, high‑performance reimplementation of Atari 2600 environments that enables massive GPU parallelization. It allows PPO agents to complete 100 M environment steps on a single A100‑GPU in under an hour, far faster than the CPU‑based ALE. Additionally, JAXtari provides object‑centric observations and a flexible modification system, facilitating research into causal modeling, neuro‑symbolic methods, and rapid agent adaptation.

By Quentin Delfosse, Raban Emunds, Paul Seitz, Sebastian Wette, Jannis Bl\"uml, Daniel Kirn, Dominik Mandok, Kristian Kersting
arXiv AI
Oct 19

Reason-guided Human Reward Modeling for Preference-based Reinforcement Learning

The paper introduces a reason-guided preference-based reinforcement learning framework that learns a human reward model from trajectory-level feedback. It augments traditional preference labels with reason tags that explain why a behavior is preferred, thereby capturing both human choices and their underlying rationale. By combining the learned human reward with the environment reward during policy optimization, the agent can improve task performance while producing more interpretable, human-aligned, and preference-sensitive behavior.

By Anshul Nayak, Shahil Shaik, Jonathan Smereka, Yue Wang