AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,805 stories · RSS feed

arXiv Computation and Language
Aug 25

MIRROR: A Multi-Agent Framework with Iterative Adaptive Revision and Hierarchical Retrieval for Optimization Modeling in Operations Research

arXiv:2602.03318v4 Announce Type: replace Abstract: Operations Research (OR) relies on expert-driven modeling--a slow and fragile process ill-suited to novel scenarios. While large language models (L...

By Yifan Shi, Jiayi Wang, Minyi Wu, Ye Fan, Jialong Shi, Jianyong Sun
arXiv Computer Vision
Aug 25

LoViF 2026 The First Challenge on Unified Removal of Raindrops and Reflections: Methods and Results

arXiv:2608.22723v1 Announce Type: new Abstract: This workshop paper comprehensively reviews the First Challenge on Unified Removal of Raindrops and Reflections. The challenge aims to address a freque...

By Zewei He, Xi Tong, Yu Chen, Xingyu Liu, Xin Li, Zepeng Wang, Jiagao Hu, Fuhao Li, Yuxuan Chen, Fei Wang, Daiguo Zhou, Minmin Yi, Chuanrui Zhang, Liwen Zhang, Yeongjin Jeong, Hyunjin Cho, Jiwon Lee, Minsang Kim, Jae Woong Soh, Jin-Hui Jiang, Rong-Lin Jian, Chih-Chung Hsu, Youngjin Oh, Junhyeong Kwon, Junyoung Park, Jae Hyun Park, Sung Ju Lee, Nam Ik Cho, Vishwajeet Shukla, Himanshu Baurai, Zhiqi Zhang, Kui Jiang, Zhaocheng Yu, Runzhe Li, Dawei Fan, Hao Li, Zhanshuo Zhang, Fan Ji, Jiangmeng Li, Xiongxin Tang, Fanjiang Xu, Shangquan Sun, Anh-Kiet Duong, Petra Gomez-Kr\"amer, Jean-Michel Carozza, Ruibo Zhang, Dexiang Hong, Xinyan Liu, Shengeng Tang, Weidong Chen, Tzu-Hsuan Weng, Min-Te Sun
arXiv Computer Vision
Aug 25

VeCAS: Vessel-Focused Contrast-Free Angiogram Synthesis for Vascular Interventions

VeCAS is a two‑stage framework that generates contrast‑free X‑ray angiograms from non‑contrast images. Stage I localizes vascular structures using a discriminative model and cross‑modality latent distillation, while Stage II synthesizes angiographic appearance within those regions with a vessel‑focused inpainting model. Experiments on a lower‑limb vascular intervention dataset show that VeCAS improves vascular structural fidelity and image quality, and robotic guidewire navigation tests demonstrate significant reductions in time to target and operation steps.

By De-Xing Huang, Chen-Yu Wang, Hao Liang, Xiao-Hu Zhou, Mei-Jiang Gui, Tian-Yu Xiang, Qin-Yi Zhang, Chen Wang, Xiao-Liang Xie, Shi-Qi Liu, Ming-Yuan Liu, Zhen-Chang Wang, Zeng-Guang Hou
arXiv AI
Aug 25

One Request, Multiple Experts: LLM Orchestrates Domain Specific Models via Adaptive Task Routing

The paper introduces ADN‑Agent, an architecture that uses a large language model to orchestrate multiple domain‑specific models (DSMs) for active distribution network (ADN) management. It features adaptive intent recognition, task decomposition, and a unified communication interface for heterogeneous DSMs, along with a pipeline for fine‑tuning small language models on language‑intensive subtasks. Experiments show ADN‑Agent outperforms existing LLM application paradigms in coordinating DSMs for complex ADN operations.

By Xu Yang, Chenhui Lin, Haotian Liu, Qi Wang, Yue Yang, Wenchuan Wu
arXiv AI
Aug 25

TO-Agents: A Multi-Agent AI Framework for Subjective Preference-Guided Topology Optimization

TO-Agents is a multi‑agent AI framework that translates natural‑language design intent into iterative topology optimization. It converts a human problem description into solver inputs, runs the optimizer, renders 3D topologies, and employs a judge agent to critique and revise results using multiview vision‑language reasoning. Evaluated on a cantilever beam and a phone‑stand design, the system achieved preference‑aligned designs in 60% of trials, outperforming an ablated pipeline by up to six times and enabling end‑to‑end intent‑to‑prototype design with additive manufacturing.

By Isabella A. Stewart, Hongrui Chen, Faez Ahmed
arXiv Computer Vision
Aug 25

HOT-POT: Optimal Transport for Sparse Stereo Matching

The paper introduces HOT-POT, a method that applies optimal transport to sparse stereo matching, addressing challenges such as occlusions, motion, and camera distortions. By modeling camera‑projected points as half‑lines and using epipolar and 3D ray distances as cost functions, the authors formulate efficient assignment problems for unsupervised sparse matching. The approach is extended to hierarchical optimal transport for unsupervised object matching, with experiments demonstrating its effectiveness in facial analysis for aligning different landmarking conventions.

By Antonin Clerc, Michael Quellmalz, Moritz Piening, Philipp Flotho, Gregor Kornhardt, Gabriele Steidl
arXiv Computer Vision
Aug 25

ViSMoE: Visual-Aware Sparse Mixture-of-Experts for Embodied Referring Expression Grounding

ViSMoE introduces a visual‑aware sparse Mixture‑of‑Experts framework for embodied referring expression grounding, enabling an agent to navigate real environments and localize a target object from natural language instructions. By routing visual information through specialized experts, the method produces discriminative representations for both navigation views and candidate objects, unlike prior approaches that use a single vision encoder. Experiments on the REVERIE and SOON datasets show that ViSMoE surpasses existing state‑of‑the‑art methods.

By Shuo Feng, Piji Li
arXiv Computer Vision
Aug 25

DRAgent: Discriminative Reasoning Agent for Referring Expression Segmentation

DRAgent introduces a discriminative reasoning framework for Referring Expression Segmentation that replaces direct coordinate prediction with a two‑stage selection process. First, a detector generates candidate boxes; then a multimodal large language model (MLLM) discriminates the correct target through high‑recall screening and instance‑wise verification. The chosen box serves as a spatial prompt for a foundation segmentation model, and a self‑consistency‑filtered data pipeline is used for LoRA‑based fine‑tuning, yielding competitive results on RefCOCO, RefCOCO+, and RefCOCOg.

By Yujie Qi, Luyan Zhang
arXiv AI
Aug 25

Designing Benchmarks for Knowledge Work

The paper proposes a new way to describe benchmarks for AI systems that perform knowledge work, outlining four explicit fields: represented activity, tested setting, required work product, and evaluated result. It builds an inventory of 18 work activities from O*NET to enable activity-level reporting across occupations, and evaluates these activities for semantic coherence, algorithm sensitivity, ontology legibility, and human interpretability. The authors apply their framework to three existing benchmarks—GDPval, OfficeQA Pro, and APEX-SWE—to show how different aspects of work can be captured within the same representation.

By Yining Hua, Hongbin Na, Cyrus Ayubcha, Levi Lian
arXiv AI
Aug 25

Chain of Operators: An Inference-Time Harness for In-Context Operator Learning

Chain of Operators (CHOP) is a framework that enables frozen scientific foundation models to tackle out‑of‑distribution (OOD) tasks without any parameter updates. By leveraging In‑Context Operator Networks (ICON), CHOP breaks down unfamiliar problems into sequences of explicit mathematical operations and model calls, effectively translating OOD queries into the model’s learned regime. Experiments on PDE benchmarks and air‑quality forecasting show that CHOP consistently reduces inference errors while maintaining full interpretability and cross‑equation generalization.

By Minghui Yang, Chenghan Wu, Ling Guo, Liu Yang
arXiv Computation and Language
Aug 25

SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents

The paper "SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents" investigates how agent skills—task‑specific instructions, scripts, and resources—can be exploited to create a trusted instruction channel that enables token amplification attacks. It introduces a two‑phase framework, SkillBloat, which first screens a library of attack‑type conditions across multiple amplification mechanisms and then refines the strongest candidate through LLM‑guided full‑document skill rewriting. Evaluated on a real‑world skill benchmark, SkillBloat achieves an average best amplification of 5.4184×–10.1455× across multiple coding‑agent target configurations, and an ablation study shows that the second‑stage refinement consistently improves performance over the initial screening alone.

By Yuanjin Zheng, Jingbang Chen
arXiv AI
Aug 25

Effects of Theory of Mind and Prosocial Beliefs on Steering Human-Aligned Behaviors of LLMs in Ultimatum Games

The study examines how Theory of Mind (ToM) reasoning and prosocial beliefs influence large language models (LLMs) in the ultimatum game. By initializing LLM agents with Greedy, Fair, or Selfless beliefs and applying chain‑of‑thought or varying levels of ToM reasoning, the authors ran 2,700 simulations across several models, including o3‑mini and DeepSeek‑R1 Distilled Qwen 32B. Results show that ToM‑enhanced LLMs align more closely with human decision patterns, exhibit greater consistency, and achieve better negotiation outcomes, with Llama 3.3 70B producing the most belief‑consistent reasoning. whyItMatters":"The findings clarify the importance of incorporating Theory of Mind into LLMs to improve their alignment with human norms in cooperative decision‑making tasks."

By Neemesh Yadav, Yihuai Lan, Shan Dong, Mai Hieu Hien, Palakorn Achananuparp, Jing Jiang, Ee-Peng Lim
arXiv Computer Vision
Aug 25

Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline

The paper introduces an agentic AI Scientist workflow that automates the entire baseline development process for medical imaging by combining literature-guided reasoning, automated code generation, and hypothesis-driven experimentation. Evaluated on four public benchmarks covering segmentation, classification, and detection, the pipeline consistently improves validation performance, achieving competitive leaderboard results such as 6th place on both PUMA tracks and 31st on MILK10k. The approach also shows strong domain generalization on MIDOG25 across scanners, tumor types, and species, demonstrating that a skill-based, literature-guided agentic workflow can reduce engineering effort without task-specific redesign.

By Eugenia Moris, Jos\'e Ignacio Orlando
arXiv AI
Aug 25

MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving

MPCFormer is a physics‑informed, data‑driven framework that explicitly models multi‑vehicle social interaction dynamics for autonomous driving. It uses a Transformer‑based encoder‑decoder to learn discrete state‑space dynamics from naturalistic data, enabling explainable, human‑like behavior planning within a Model Predictive Control (MPC) framework. In open‑loop NGSIM tests, it achieves the lowest trajectory prediction errors (ADE 0.86 m over 5 s), and in closed‑loop intense interaction scenarios it attains a 94.67 % planning success rate, 15.75 % efficiency gain, and reduces collisions from 21.25 % to 0.5 %.

By Jia Hu, Zhexi Lian, Xuerun Yan, Ruiang Bi, Dou Shen, Yu Ruan, Chunlong Xia, Haoran Wang