AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,576 stories · RSS feed

arXiv AI
1d ago

OdorSpaces: Visual-Olfactory Embodied Navigation in 3D Environments

OdorSpaces is a physics‑based simulation platform that extends Habitat‑Sim with 3D odor transport and dispersion modeled by Fire Dynamics Simulator, allowing agents to navigate photorealistic indoor environments using both visual and olfactory data. The benchmark presents two source‑seeking tasks—an invisible gas‑leak and an early‑stage fire—providing a realistic testbed for visual‑olfactory embodied navigation. An initial multimodal reinforcement learning policy that fuses visual observations with temporal olfactory measurements outperforms several baselines, establishing a strong reference for future research.

By Changyeon Lee, Kelin Yu, Zheng Wei, Shuna Ni, Ruohan Gao
arXiv AI
1d ago

Learning When Human Decisions Matter: Executor-Relative Consultation Value for LLM Agents

The paper introduces Consultation Value Distillation (CVD), a method for estimating when a large language model (LLM) should seek human input given limited consultation opportunities. CVD uses offline Monte Carlo rollouts to learn executor-dependent consultation values, then distills these into lightweight predictors that enable efficient budgeted allocation without further rollouts. Experiments across multiple batch and sequential settings show that CVD outperforms direct prompting and Value of Information approaches, achieving near‑lossless allocation with lower search costs.

By Shuli Jiang, Khushbu Pahwa, Yuting Zhang, Yi Zhang, Wei Xia, Stefano Soatto
arXiv AI
1d ago

CellCanon: An Agentic Cellular World Model for Prediction, Explanation, and Observation-Driven Updating

CellCanon is an agentic cellular world model that integrates single‑cell expression prediction, evidence‑grounded explanation, and observation‑driven updating. Its predictive core reuses condition‑level biological evidence to generate gene‑specific readouts, while a shared world state links predictions, measurements, and source‑linked claims to support explanation and revision. On 339 held‑out SciPlex3 conditions across three cell lines, CellCanon outperforms baselines in differential‑expression AUPRC, Macro‑F1, and direction Macro‑F1, and its explanation module correctly answers all answerable questions with supporting proofs.

By Zhaokang Liang, Shuyang Zhuang, Xiaoran Jiao, Hao Chen
arXiv AI
1d ago

Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription

Confucius4‑R2T2, a stable‑prefix streaming ASR model, is introduced to ensure that once a token is emitted it is never revised, thereby reducing wasted work and incorrect actions in real‑time transcription. The model is derived by post‑training Qwen3‑ASR‑1.7B on 1,500 hours of Chinese and English audio while keeping its audio encoder frozen, and it leverages a new concept called Longest Stable Prefix (LSP) to convert a full‑context model into a stable‑prefix streaming one without architectural changes. Evaluation shows that R2T2 achieves near full‑context quality with low latency and stable output, and its benefits generalize beyond the languages used in training.

By Daniel Huang, Qi He, Shaoxiong Duan, Yingjie Li, Qiao Cheng, Yitao Duan
arXiv AI
1d ago

CoSafe: Cooperative Runtime Safety Assurance for Mixed-Traffic Autonomous Driving

CoSafe is a modular, ADS-agnostic framework that extends runtime safety assurance from ego-centric takeover to scene-level cooperative intervention in mixed-traffic autonomous driving. It uses vehicle-to-everything communication to allow roadside units to monitor hazards and jointly mitigate risks involving multiple vehicles. Evaluation on the InterDrive benchmark shows that CoSafe improves driving scores by 70.03%, reduces safety violations by 87.80%, and accurately identifies unsafe autonomous vehicles with an F3 score of 0.930 while meeting real-time constraints.

By Dingji Wang, You Lu, Haowen Jiang, Yanggang Chen, Yuyang Bi, Bihuan Chen, Shenglin Bao, Xin Peng
arXiv AI
1d ago

AgentTrustCI: Build-Time Policy, Grounding, and Trajectory Tests for Java LLM Agents

AgentTrustCI is a Java/JUnit 5 framework that turns application‑layer expectations—such as tool selection, grounding of answers, and adherence to workflows—into policy, grounding, and trajectory checks over recorded traces. It provides deterministic replay for repeatable build‑time tests and a judge interface for optional semantic evaluation. In tests across 55 synthetic cases from seven enterprise domains, the full pipeline correctly classified all injected faults and passing controls, while single‑layer configurations handled 35 cases, demonstrating the framework’s coverage and repeatability.

By Sachin Gupta
arXiv AI
1d ago

Learning to Learn from Multimodal Experience

The paper introduces AutoMMemo, a framework that lets agents automatically design memory mechanisms for learning from multimodal experience. Each memory mechanism is represented as an executable memo program that specifies how past episodes are stored, organized, and retrieved. Through iterative evaluation, reflection-guided mutation, and budget-aware tree search, AutoMMemo learns effective memory designs that improve agent performance on GUI/Web navigation and multimodal visual reasoning tasks while keeping token and interaction costs reasonable.

By Xingyu Sui, Weixiang Zhao, Yongxin Tang, Yanyan Zhao, Yang Wu, Dandan Tu, Bing Qin
arXiv AI
1d ago

Quantifying Local and Global Fidelity of Nonlinear Embeddings

The paper introduces the DLP curve, a metric that quantifies how well nonlinear embeddings like t‑SNE and UMAP preserve local and global structure by measuring the share of each point’s k‑nearest neighbors retained in the map. Corrected for chance, the curve yields local fidelity (L) at k=10 and global fidelity (G) over 30–50% of the data, with the midpoint provably equivalent to a rank correlation of distances. The authors also present the LG reversal test to compare two maps and the entity fidelity (E) to predict which entities a map loses, demonstrating strong agreement with established global scores on twelve large datasets.

By Henry Han
arXiv AI
1d ago

Signals: Continuous Diagnostics of AI Agents

The paper "Signals: Continuous Diagnostics of AI Agents" introduces a method for diagnosing problems in AI agents by analyzing agentic traces. It defines 45 problem types across eight families, categorizes findings into engineering issues called Signals, and assesses their severity. The method was evaluated on public agent executions, achieving a 91.43% F1 score in matching Signals to reference issues, outperforming a one-pass LLM control by about 18 percentage points.

By Amey Rambatla, Vatsal Goel, Sagar Gaur, Siddhant Loya, Anurag Mishra, Asif Mohammad
arXiv AI
1d ago

Population-Aligned Persona Generation for LLM-based Social Simulation

arXiv:2509.10127v3 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have enabled large-scale, high-fidelity social simulations, creating new opportunities for co...

By Zhengyu Hu, Jianxun Lian, Zheyuan Xiao, Max Xiong, Tianfu Wang, Teng Xiao, Yuxuan Lei, Fengqing Jiang, Kaize Ding, Ziang Xiao, Nicholas Jing Yuan, Xing Xie, Radha Poovendran
arXiv Machine Learning
1d ago

NorthCUA Technical Report: Turbocharging Computer-Use Agents through Experience at Scale

arXiv:2611.02102v3 Announce Type: replace Abstract: Scaling computer-use agents from individual actions to complex software work requires experience that connects decisions to complete outcomes. We p...

By Chaoyun Zhang, Bingxuan Li, Pinxue Guo, Yangfan Gao, Zikun Cai, Tianci Xie, Hui Li, Yuqi Huang, Yifei Cao, Bo Mao, Tian Tang, Qichang Zheng, Tongtong Liu, Xiaoxing Wang, Jinxiu Liu, Lizhi Lin, Zhou Shao, Maosen Zhou, Miao Zheng, Shuo Zhang, Yangji He, Kepeng Lei, Ning Zhao, Wei Shen, Zhenjiang Jin, Xinyue Zhang, Peng Sun, Zhenhua Han, Rui Zheng, Hang Yan
arXiv Computation and Language
1d ago

Prospective Memory for Proactive LLM Agents

arXiv:2611.05731v1 Announce Type: new Abstract: Most memory systems for LLM agents are retrospective, preserving and retrieving past information to inform current decisions. Proactive agents, however...

By Yuanchen Bei, Zhining Liu, Tianxin Wei, Weizhi Zhang, Zhichen Zeng, Philip S. Yu, Hendrik Hamann, Jingrui He, Hanghang Tong