AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,733 stories · RSS feed

arXiv AI
Oct 27

Estimation of Propagated Risk in LLM-based Multi-Agent Systems

The paper introduces Interaction-Effect Propagation (IE-Prop), a model that estimates error risk in large language model (LLM) based multi‑agent systems by conditioning on whether upstream agents are correct or incorrect. IE‑Prop learns separate effects for each sender‑receiver interaction, combines them using the sender’s estimated error risk, and recursively propagates these risks through the execution graph. Experiments on three architectures and benchmarks show that IE‑Prop improves final‑node AUROC by about 0.05 points over baselines and that multi‑step risk tracking adds an additional 0.03 AUROC in sequential systems.

By Shreyan Ganguly, Souradeep Chattopadhyay, Qisai Liu, Soumik Sarkar
arXiv AI
Oct 27

FraudSociety: A Generative Agent-Based Society for the Financial-Fraud Economy

FraudSociety is a novel LLM‑agent‑based simulator that jointly models informational and financial dynamics in the financial‑fraud economy. It features a dynamic social environment, persistent financial ledgers, and a Need‑Intent‑Action architecture, allowing fraudsters to adapt their actions based on interaction histories and ledger states. Validation shows macro‑level outcomes match real‑world patterns, micro‑level loss concentration aligns with Canadian statistics, and personalized interventions can dramatically reduce repeat‑payment rates.

By Keyang Chen, Mingxuan Jiang, Zeping Li, Yiwen Zhao, Yifan Wang, Qiuyang Zhang, Shuaicheng Qi, Yicun Liu, Zhixin Li, Sen Liu, Yinan Jing, Guangnan Ye, Hongfeng Chai
arXiv AI
Oct 27

Improving Instruction Hierarchy by Learning from Goal-Goal Conflicts

The paper discusses how instruction hierarchy (IH) can be improved by training large language models on simulated instruction conflicts, particularly a newly identified type called goal‑goal conflicts. By fine‑tuning Qwen3.5‑9B and Gemma4‑12B‑it on examples of these conflicts, the authors demonstrate significant gains in IH performance across a variety of real‑world tasks, while maintaining negligible impact on non‑conflict tasks. The study suggests that incorporating goal‑goal conflicts into IH training sets can enhance model adherence to higher‑priority instructions.

By Sizhe Chen, Sanjay Kariyappa, Liwei Jiang, Chong Xiang, Jihye Choi, Chaowei Xiao, G. Edward Suh
arXiv AI
Oct 27

Large Language Models: A Plain-Language Overview for Engineers

Large Language Models: A Plain-Language Overview for Engineers explains that LLMs are neural networks trained on vast text collections to predict subsequent words, and outlines key concepts such as Transformers, pre‑training, fine‑tuning, reinforcement learning from human feedback, retrieval‑augmented generation, chain‑of‑thought prompting, and tool‑using agents. It also discusses efficiency techniques like FlashAttention and QLoRA, provides a life‑cycle figure and comparative tables, and offers a checklist for evaluating LLM claims, including checks for data contamination, model‑based grading, long‑context handling, and hallucination. The article aims to give engineers a clear picture of how training changes and prompts affect generative AI tools like ChatGPT.

By Bahaeddin T\"urko\u{g}lu
arXiv AI
Oct 27

Profiling a Frontier Agent with EBench: From Direct Control to Harness with Policy

The report evaluates the GPT-6-Astra multimodal large language model (MLLM) on the EBench platform, comparing two agent configurations: direct control, where the agent generates waypoint commands, and harness with policy, where it can invoke post‑trained vision‑language‑action (VLA) or world action model (WAM) policies. Direct control performs competitively overall, excelling on short‑horizon tasks and showing stable generalization, but falls behind on long‑horizon, tabletop, and high‑precision contact‑rich tasks. The harness with policy approach combines the strengths of both components, achieving success rates comparable to the best post‑trained policies while reducing token cost, yet still lags behind the standalone upper bounds due to suboptimal policy invocation and execution issues.

By Yifei Yao, Yude Zou, Guanbo Jiao, Xing Gao, Ning Gao, Yukai Wang, Jiantong Chen, Zihou Zhu, Xinyu Li, Ningyu Yan, Shuai Wang, Jianming Ma, Haoyu Guo, Weinan Zhang, Chunhua Shen
arXiv AI
Oct 27

LiveOption: Evaluating LLM Agents in Structured Option Trading with Nonlinear Payoffs

LiveOption is an evaluation framework designed to assess large language model (LLM) agents in option trading, a domain characterized by nonlinear payoffs and multi-leg strategy construction. The framework treats option trading as structured sequential decision-making under realistic execution and capital constraints, offering a reproducible environment with standardized interaction protocols. It includes three task suites—portfolio overlays, event-driven earnings trading, and 0DTE intraday trading—and introduces a hierarchical metric suite that evaluates action validity, decision quality, risk characteristics, and outcome-level performance, revealing that current agents often fail to achieve competitive returns.

By Haochen Luo, Yifan Li, Binh Minh An, Xiaolong Luo, Zhengzhao Lai, Yuan Zhang, Chen Liu
arXiv AI
Oct 27

AOS-Bench: Can LLM Agents Manage Dynamic Workloads?

AOS-Bench evaluates large language model agents as dynamic workload managers, testing their ability to handle multiple concurrent tasks under shared CPU and memory limits. The benchmark shows that isolated task success does not predict performance in a streaming workload, with significant drops in heavy and medium scenarios. Execution‑policy experiments reveal that simple concurrency controls can rival more complex management strategies, highlighting the importance of workload management as a distinct agent capability.

By Erle Zhu, Genrui Zhang, Keyang Hu, Mingyu Su, Hongning Wang
arXiv AI
Oct 27

Seeing the Options: Typed Decisions over Visual Candidates with Reusable Option Memory

The paper introduces Iris, a framework that extends typed decision‑making models to multimodal settings where candidates can be images, text, or hybrids. Iris preserves key properties such as candidate‑order invariance, scalability, and cache reuse, and achieves high accuracy on a visual‑candidate benchmark while reducing latency through efficient encoding strategies. The authors also demonstrate significant speedups on GPU systems and outperform larger baseline models on MetaEncoder benchmarks.

By Fengxin Li
arXiv AI
Oct 27

Pretraining Knows What, Simulation Teaches How: Compositional Generalization in a Sim-Trained Robot Agent

arXiv:2610.35817v1 Announce Type: cross Abstract: A robot policy needs to understand what a task is asking for in a scene, and how to move the robot to accomplish that task. To achieve these two skil...

By Benjamin Pikus, Daniel Saunders, Mircea Mironenco, Salman Mohammadi, Mathew Mathew, Sirou Zhu, Divya Makkar, Xuhua Huang, Qinbo Li, Supreeth Narasimhaswamy, Siyuan Cen, Thomas Neff, Dejia Xu, Shyamal Buch