AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,750 stories · RSS feed

arXiv AI
Sep 15

EvoOntology: A Self-Evolving Ontology Layer for Data Agents

EvoOntology introduces a self‑evolving ontology layer for data agents, encapsulating the ontology as an MCP server with schema, content, and tool layers. It enables agents to query and interact with the ontology at runtime, using a builder agent for autonomous construction and a self‑evolution loop that refines the ontology through attribution‑guided edits validated by backbone‑conditional evaluation. Experiments on three data‑agent benchmarks with four LLM backbones show that EvoOntology consistently outperforms strong baselines and existing semantic‑layer approaches, effectively bridging the agent‑data gap for heterogeneous data.

By Meiduo Chong, Shaolei Zhang, Ju Fan, Xiaoyong Du
arXiv AI
Sep 15

VisInteract: Towards Dynamic Interactive Text-to-Visualization under Imperfect Queries

VisInteract introduces a new paradigm for Text-to-Visualization that treats imperfect user queries as a dynamic, interaction-driven problem, requiring the system to recover true intent through multi-turn dialogue. The authors present VisInteract-Bench, the first benchmark for interactive Text-to-Vis, featuring controlled imperfection injection, a realistic user agent, and dual-perspective automated evaluation. They also propose Vis-MCTS, an enhanced Monte Carlo Tree Search algorithm that incorporates progressive widening, cross-rollout information sharing, and dimension-aware reward decomposition, achieving significant performance gains over existing baselines.

By Wenxin Xu, Jinwei Lu, Hwanhee Kim, Chen Jason Zhang, Xiao-Yong Wei, Haoyang Li, Yuanfeng Song
arXiv AI
Sep 15

When Tool Calls Succeed but Workflows Fail: Anomalies at the Agent-Tool Boundary

The paper investigates how AI agents that run long workflows using external tools can experience inconsistencies when retries, speculative execution, concurrency, or partial failures occur. It introduces an effect‑history model that distinguishes between actual external events and the agent’s observations, and catalogs eight common external‑effect anomalies. The authors analyze the standard Model Context Protocol tool interface, finding that its annotations are too coarse to fully express the necessary capabilities to prevent these anomalies, thereby motivating the need for reusable transactional contracts at the agent‑tool boundary.

By Artem Trofimov, Boris Novikov
arXiv AI
Sep 15

Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Science

Stellar Colosseum is a model‑agnostic harness designed to improve long‑horizon research in mathematics and theoretical computer science by allocating inference across multiple agents. It explores alternative strategies before constructing proofs, uses a readiness gate to decide when a route is mature enough to decompose, represents proof plans as interdependent subproblems, and routes verifier findings back to the relevant part of the argument. The workflow generates candidates in parallel, attacks them with targeted falsification, and combines candidates and critiques into a single research artifact through overlapping random‑sample tree aggregation, and has been integrated into Google Antigravity's Teamwork framework as the Long Proof pattern. Demonstrations show that, when paired with Gemini 3.1 Pro, Stellar Colosseum achieves 71.0% accuracy on the TCS‑Bench theorem‑proving benchmark and solves 218 of 222 Codeforces problems.

By Honghao Lin, David P. Woodruff, Yuan Deng, Jieming Mao, Song Zuo, Vahab Mirrokni
arXiv AI
Sep 15

A note on goal-based hierarchical RL

The paper discusses the agent-centric general value function (ACGVF) framework, which allows an agent to decide both which goal to pursue and when to consider a goal finished, beyond merely selecting actions. It notes that ACGVF assumes full observability, while a prior approach used an internal belief state but required externally supplied goals. The note proposes to unify and extend these methods using hierarchical hidden Markov models (HHMMs).

By Kevin Murphy
arXiv Computer Vision
Sep 15

Habitat-GS: A High-Fidelity Navigation Simulator with Dynamic Gaussian Splatting

Habitat-GS is a navigation-focused embodied AI simulator that extends Habitat‑Sim by incorporating 3D Gaussian Splatting (3DGS) for real‑time photorealistic rendering and scalable asset import. It introduces a Gaussian avatar module that represents dynamic humans as both photorealistic visual entities and navigation obstacles, enabling agents to learn human‑aware behaviors. Experiments show that agents trained on 3DGS scenes generalize better across domains and that the avatar system supports effective human‑aware navigation while maintaining system scalability.

By Ziyuan Xia, Jingyi Xu, Chong Cui, Yuanhong Yu, Jiazhao Zhang, Qingsong Yan, Tao Ni, Junbo Chen, Xiaowei Zhou, Hujun Bao, Ruizhen Hu, Sida Peng
arXiv AI
Sep 15

Empirical Evaluation of Task-Based Permission Scoping Architecture for AI Agents

The paper evaluates a task-based permission scoping architecture for AI agents, comparing a fine‑tuned RoBERTa‑large encoder to few‑shot Claude Haiku 4.5 on a 600‑prompt dataset. It shows the new system achieves comparable macro‑F1 (0.881 vs. 0.886) and higher precision (0.897 vs. 0.842), while reducing severity‑weighted residual risk from 1.12 to 0.63. The study also introduces an attack‑surface elimination metric, demonstrating that task‑granular control can close 84.4% of the severity‑weighted surface, far surpassing role‑based ceilings alone.

By Halil Burak Noyan
arXiv AI
Sep 15

An Evolutionary Computation Framework for Multi-Agent Q-Learning with Mean-Field Environmental Feedback

The paper presents a mean‑field framework for studying multi‑agent Q‑learning in networked populations, where agents update stateless Q‑values on a fixed graph while the average behavior of the population feeds back to modify the payoff matrix. A deterministic transport equation for the distribution of Q‑values is derived and coupled with a discrete update for the environmental state, and the model is validated against Monte Carlo simulations on several random graph topologies. Results show that the mean‑field system captures macroscopic cooperation dynamics, that environmental feedback reshapes action‑value ordering, and that the timescale of environmental response critically influences learning outcomes.

By Lichen Wang, Shijia Hua, Linjie Liu
arXiv Computer Vision
Sep 15

MedVA: An End-to-End Neuro-Symbolic Agentic System for Medical Volume Visualization

MedVA is an end‑to‑end neuro‑symbolic agentic system designed to streamline medical volume visualization. It combines a neuro‑symbolic intent formulation agent that refines natural‑language requests with symbolic reasoning, a multi‑model ROI identification agent that uses pretrained medical segmentation models to locate specified regions, and an objective‑driven visualization optimization agent that evaluates ROI visibility using a volume‑based objective. Extensive evaluations and a formative user study demonstrate the system’s effectiveness and high usability across users with varying expertise.

By Haill An, Suhyeon Kim, Minjun Kang, Eunwoo Lee, Bin Sheng, Lei Bi, Younhyun Jung
arXiv AI
Sep 15

MedSAM3: Delving into Segment Anything with Medical Concepts

MedSAM-3 is a text‑promptable medical segmentation model that builds on the Segment Anything Model (SAM) by fine‑tuning it with medical images and semantic concept labels. It enables precise anatomical segmentation through open‑vocabulary text descriptions, moving beyond purely geometric prompts. The accompanying MedSAM-3 Agent incorporates multimodal large language models to perform complex reasoning and iterative refinement, and experiments across X‑ray, MRI, ultrasound, CT, and video modalities show it outperforms existing specialist and foundation models.

By Anglin Liu, Xu R. Cao, Yifan Shen, Yi Lu, Xiang Li, Qianqian Chen, Jintai Chen
arXiv Computation and Language
Sep 15

CITECHOICE: A Causal Audit of How Document Presentation Redistributes Citation Credit in Agentic Search

CITECHOICE is a causal audit that examines how the presentation of documents in an agentic search engine redistributes citation credit. Using 129 everyday‑query transcripts, the study compares structured versus prose renderings of the same source while keeping all other transcript elements fixed. The results show that structured rendering increases the target’s citation count by about half a citation per answer without adding total citations or diminishing competitors’ credit, while also revealing that rank position has a larger effect on citation rates than presentation order alone.

By Sriram Selvam, Anneswa Ghosh
arXiv AI
Sep 15

The Garden of Forking Paths: Threading Narrative Archetype as a Semantic Signal Through Gameplay Planning

The paper introduces Forking Garden, a branching game generation system that threads narrative archetype as a persistent semantic signal throughout the generation pipeline. Narrative progression is modeled with soft Rise/Fall states, guiding the creation of plot nodes, structural constraints, encounter composition, objectives, rewards, and difficulty adaptation. Experiments across ten storylines show that the system produces distinct archetypal trajectories, improves entity diversity, and that Rise/Fall distinctions remain meaningful during play, aiding both narrative understanding and creator interpretation.

By Yunge Wen, Chenliang Huang, Hangyu Zhou, Zhuo Zeng, Yuxuan Weng, Timothy Merino, Julian Togelius, Max Kreminski, Sam Earle
arXiv Machine Learning
Sep 15

Assembling the CREW: A Collaborative Multi-agent Reinforcement Learning Framework for Automated Related Work Generation

The paper introduces CREW, a collaborative multi‑agent reinforcement learning framework that automates the generation of the Related Work Section in research papers. Unlike previous methods that follow a fixed workflow, CREW allows large language model agents to dynamically select actions—Retrieve, Disseminate, Compose, and Critique—guided by a policy trained with Independent Proximal Policy Optimization. Experiments on a standard benchmark show that CREW improves output quality and reduces token usage compared to strong baselines.

By Hai-Dang Dang, Bao-Yen Pham, Bao Nguyen, Tran Thi Huong, Huynh Thi Thanh Binh
arXiv AI
Sep 15

Semantic Knowledge Technologies: what the Semantic Web lost sight of, and what it never had

The paper critiques the Semantic Web’s failure to deliver machine‑interpretable knowledge, arguing that its standards omitted key elements—conditions for claims, operational grounding, and coverage scope—making truth, applicability, and boundary recognition impossible. It proposes a new framework, Semantic Knowledge Technologies, with a seven‑layer architecture and five measurable tests of understanding (check, connect, derive, act, delimit). The authors introduce concepts such as Large Knowledge Models, SLKMs, and a falsifiable definition of Semantic Artificial General Intelligence, presenting a research agenda to address these gaps.

By Achille Zappa
arXiv AI
Sep 15

Delegating Authorization to Misaligned Agents: Coalitional Alignment and Safe Control

The paper studies how to safely delegate action approval to multiple AI reviewers when the reviewers themselves may be misaligned. It introduces a weaker condition—k‑robust coalitional alignment—under which a threshold rule that tolerates up to k disapprovals guarantees that the principal’s expected utility is at least as good as a baseline policy. The authors extend this characterization to sequential decision‑making in discounted MDPs and show that full‑panel coverage of reward functions ensures safety in Nash equilibria, while more permissive thresholds can lead to unsafe outcomes. Experiments demonstrate that collective review can remain sound even when individual reviewers are not fully aligned, provided some disapprovals are allowed.

By Natalie Collina, Surbhi Goel, Aaron Roth, Sikata Bela Sengupta
arXiv Computer Vision
Sep 15

Closed-form Bayesian homography estimation from noisy point correspondences

The paper introduces a fast Bayesian method for estimating homographies from noisy point correspondences, providing a posterior distribution over the homography parameters. A closed‑form solution for the posterior mean in homogeneous coordinates is derived, complemented by an iterative Bayesian approach to address non‑linearities. Experiments on synthetic data and real image stitching show improved accuracy over DLT and supply uncertainty estimates for the homography.

By Hanne Beuter, Sebastian Dorn
arXiv Computer Vision
Sep 15

Learning from Reliable Negatives: Confidence-Anchored Test-Time Adaptation for GUI Grounding

The paper introduces a label‑free test‑time training approach for GUI grounding, leveraging confidence patterns in coordinate tokens rather than full‑sequence confidence. It proposes Confidence‑Anchored Learning (CAL) to filter pseudo‑labels and assign distance‑based binary rewards, and extends this to Confidence‑Anchored Negative Learning (CANL) which optimizes solely on negative samples to avoid noisy positives. Experiments show that CANL‑7B achieves 92.1% on ScreenSpot‑V2 and 33.8% on ScreenSpot‑Pro, improving the base model by 8.9%.

By Yizhou Liu, Fei Tang, Yuchen Yan, Zhengxi Lu, Songqin Nong, Tao Jiang, Wenhao Xu, Wenqi Zhang, Weiming Lu, Jun Xiao, Yongliang Shen
arXiv AI
Sep 15

Generalized Agent Iteration: One Formal Framework for Iterative Policy Improvement and Recursive Self-Improvement

The paper introduces Generalized Agent Iteration (GAI), a formal framework that unifies iterative policy improvement and recursive self‑improvement (RSI) under a single learning paradigm. GAI treats an agent as a configuration of modifiable components and models learning as a cycle of evaluation and improvement, with two key dials: whether the improving mechanism is part of the agent and whether the evaluation standard is external. These dials distinguish between generalized policy iteration (GPI) and RSI, and classify systems as anchored, goal‑drift, or fully self‑referential, allowing existing systems to be mapped and RSI defects to be analyzed systematically.

By Hongyao Tang, Yi Ma, Pengyi Li, Yifu Yuan
arXiv AI
Sep 15

Carbon-Aware Routing for Function Calling in Edge-Cloud LLM Systems

The paper presents a carbon‑aware routing framework for function‑calling in large language models that distributes queries across a three‑tier edge‑cloud architecture. A lightweight k‑NN predictor estimates accuracy, delay, and power for each edge tier, and real‑time grid carbon intensity is used to route queries to the lowest‑emission tier that can execute them. Experiments on state‑of‑the‑art benchmarks show the framework matches cloud‑level accuracy while cutting operational carbon emissions by an average of four times.

By Aikaterini Maria Panteleaki, Varatheepan Paramanayakam, Spyros Tragoudas, Iraklis Anagnostopoulos