AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,750 stories · RSS feed

arXiv AI
Sep 10

Learning to Configure Agentic AI Systems

The paper introduces ARC, a lightweight hierarchical policy that learns to configure LLM‑based agent systems on a per‑query basis by treating each configuration as a temporally extended option in a semi‑Markov decision process. Unlike fixed templates or hand‑tuned heuristics, ARC dynamically selects workflows, tools, token budgets, and prompts tailored to the difficulty of each query. Experiments on reasoning, tool‑use, and agentic benchmarks show that ARC outperforms budget‑matched tool‑augmented LLMs, boosting reasoning accuracy by 31.3%, tool‑use accuracy by 13.95%, and doubling success on the τ‑Bench Airline Pass task from 9.0% to 18.0%.

By Aditya Taparia, Som Sagar, Ransalu Senanayake
arXiv AI
Sep 10

FrogNano: Training a 4B Coding Agent via Online Task Synthesis

FrogNano is a 4B coding agent trained exclusively with reinforcement learning on about 1,500 synthetic software engineering environments. Its training leverages an online task synthesis pipeline that generates tasks at the current agent’s learnability frontier, improving performance without distilling from larger models. The report details the methodology, evaluates the agent across diverse environments, and analyzes its effectiveness as a lightweight coding agent for minimal hardware.

By Minseon Kim, Zhengyan Shi, Emiliano Penaloza, Christopher Cui, Roger Creus Castanyer, Maryam Hashemzadeh, Isadora White, Jonathan Light, Jeonghye Kim, Matheus Pereira, Darya Moldavskaya, Chinmay Singh, Fabio Vera, Baolin Peng, Xingdi Yuan, Marc-Alexandre C\^ot\'e, Alessandro Sordoni
arXiv Computation and Language
Sep 10

UnitBoost: Managing Compound LLM Systems with a Merge Operator, Not a Model

UnitBoost proposes a non‑generative merge operator to manage compound LLM systems, replacing the opaque higher‑level LLM that traditionally coordinates worker outputs. The operator maps worker outputs to slot‑value proposals, uses a constrained argmax to assemble the final answer, and explicitly tracks unfilled slots as residuals for subsequent rounds, thereby achieving order‑free processing and unit provenance. Across three held‑out benchmarks, UnitBoost outperforms both gold‑label‑selected candidates and input‑matched generative managers, improving compound‑system performance by up to 0.182 points and raising FanOutQA cell F1 from 0.4778 to 0.5524.

By Xing Zhang, Guanghui Wang, Yanwei Cui, Mengdie Flora Wang, Peiyang He
arXiv AI
Sep 10

Online Surrogate Repair: Decoupling High-Fidelity Feedback from Search Length in Closed-Loop Discovery

The paper introduces Online Surrogate Repair (OSR), a closed‑loop algorithm that decouples the frequency of high‑fidelity evaluations from the length of an agent’s search by selectively updating a surrogate model with sparse, high‑fidelity data. An acquisition rule determines which candidate designs receive expensive evaluations, and the resulting labels refine the surrogate for subsequent episodes. Experiments on synthetic environments and the MADE benchmark show that OSR can reduce regret more efficiently than fixed‑surrogate approaches, requiring fewer oracle queries than high‑fidelity feedback after every episode.

By Xiaotang Feng, Philip Torr, Bruno Andreis
arXiv AI
Sep 10

X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR

X2Streaming-ASR introduces a method for streaming automatic speech recognition that separates the decision of when to commit a transcript from what to commit. The approach uses a three‑stage training process: first establishing streaming capability, then warm‑starting a commit policy with automatically probed trajectories, and finally refining the policy with character‑level, segment‑assigned group‑relative rewards for accuracy and latency. On AISHELL‑1/2/3 and WenetSpeech datasets, the system achieves mean character‑level commit latencies of 27–84 ms, far lower than baseline systems, while also attaining the best streaming character error rates on AISHELL‑1 and AISHELL‑3.

By Zhiwei Lin, Kaiqi Fu, Rime Wen, Zehan Liu, Shawn Qin, Roy Gan, Hao Wang, Qian Wang
arXiv AI
Sep 10

Open Tabular Insight Extraction: Where Do We Stand, and Where Should We Go?

The paper introduces Open Tabular Insight Extraction (OpenTI), a unified framework aimed at democratizing access to insights from large table corpora. It highlights how current research is fragmented across domains like table QA, text‑to‑SQL, and data analysis agents, and shows that existing systems and benchmarks fall short of covering the full end‑to‑end scope of OpenTI. The authors propose a consolidated terminology, conduct a systematic review, and outline a research agenda for developing comprehensive OpenTI systems, evaluation methods, and interaction paradigms.

By Daniel Gomm, Maarten de Rijke, Madelon Hulsebos
arXiv AI
Sep 10

Latent Preference Modeling for Multi-Session Personalized Tool Calling

The paper introduces the Multi-Session Personalized Tool Calling (MPT) benchmark, containing 4,695 instances across 459 multi‑session histories that test Preference Recall, Induction, and Transfer. It proposes PRefine, a test‑time memory method that refines a user’s latent preference via a generate‑verify‑refine loop. Experiments with five LLMs show that PRefine outperforms existing memory systems and even full‑history prompting on Preference Transfer, suggesting that personalized agents should encode behavior as preferences rather than merely storing past interactions.

By Yejin Yoon, Minseo Kim, Taeuk Kim
Simon Willison
Sep 9

.blend URL Viewer

Simon Willison created a .blend URL Viewer tool that lets users view a Blender model of a Fabergé egg themed after the TV show Pluribus directly in their browser. He generated the egg image using ChatGPT Images 2.5, then fed it to GPT‑6 Astra with a custom Blender skill to produce several .blend files. The viewer, built with JavaScript, is now part of his tools collection for easy access to the resulting 3D model.

Mistral AI
Sep 9

Modernizing complex legacy code with AI agents.

Mistral AI assisted a European energy operator in modernizing a substantial legacy codebase by migrating 40,000 lines of Fortran 77 to C++. The project showcases the practical application of AI agents in refactoring complex code, detailing the process and key lessons learned. It serves as a case study for similar modernization efforts in the industry.