AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,805 stories · RSS feed

arXiv Computer Vision

Aug 25

Environmental Injection Attacks against GUI Agents in Realistic Dynamic Environments

arXiv:2509.11250v3 Announce Type: replace-cross Abstract: Graphical User Interface (GUI) agents are increasingly deployed to interact with online web services, yet their exposure to open-world conten...

By Yitong Zhang, Ximo Li, Liyi Cai, Jia Li

llms agents

arXiv Computer Vision

Aug 25

Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation

arXiv:2607.10744v5 Announce Type: replace Abstract: Benefiting from the powerful priors embedded in large-scale pre-training data and the emerging commonsense reasoning ability, large language models...

By Changfei Fu, Guangcheng Chen, Aoxiang Gu, Haoxiang Liang, Wenjun Xu, Hong Zhang

llms rag agents robotics fine-tuning multimodal benchmarks

arXiv Computer Vision

Aug 25

IntentQA: Intent Question Answering in Videos by Cognitive Context Reasoning

arXiv:2608.23330v1 Announce Type: new Abstract: Video understanding requires intelligent agents to transcend mere recognition of visual facts and comprehend the underlying intents behind human action...

By Jiapeng Li, Ping Wei, Wenjuan Han, Song-Chun Zhu, Lifeng Fan

llms agents nlp multimodal benchmarks

arXiv Computer Vision

Aug 25

MIVIFI: Bridging Perspective and Fisheye Domains for Training Multi-View Fisheye Image Generation Models

arXiv:2608.23140v1 Announce Type: new Abstract: Achieving 360{\deg} coverage is critical for the visual perception systems of autonomous vehicles. Fisheye cameras offer a cost-effective solution by e...

By Matthias Neuwirth-Trapp, Beg\"um Altunbas, Jiayi Wang, Yan Xia, Maarten Bieshaar, Xinyu Huang, Daniel Cremers

agents diffusion robotics

arXiv Computation and Language

Aug 25

Agentic-DuplexGen: Decoupling Content, Timing, and Acoustics for Synthetic Dialogue Speech

arXiv:2608.16053v2 Announce Type: replace Abstract: Synthetic conversational speech has become an important resource for developing and evaluating conversational speech systems. However, existing dia...

By Pengcheng Wang, Sheng Li, Jiyi Li, Takahiro Shinozaki

llms agents multimodal

arXiv Computation and Language

Aug 25

SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges

arXiv:2608.12129v2 Announce Type: replace Abstract: While retrieval-augmented generation (RAG) has proven effective at giving LLMs access to external knowledge, mainstream dense-retrieval implementat...

By Yuchao Wu, Junqin Li, XingCheng Liang, Yongjie Chen, Yinghao Liang, Linyuan Mo, Guanxian Li

llms rag agents benchmarks data-engineering

arXiv Computation and Language

Aug 25

Training Agents to Evolve with Their Harness: TaoLive Digital Avatar Agent Technical Report

arXiv:2608.15763v2 Announce Type: replace Abstract: AI-powered digital avatar streamers must answer product questions, engage viewers, and execute marketing strategies in real time, demanding low lat...

By TaoLive AIGC LLM Team, Yuhan Sun, Wenhao Lin, Yongdong Luo, Yibo Hu, Meiguang Jin, Junfeng Ma, Weihang Pan, Jiaxin Zhao, Zulong Chen

llms agents reinforcement-learning fine-tuning efficiency

arXiv Computation and Language

Aug 25

The Laws of Context Allocation: Causal Measurement and Closed-Loop Orchestration in Generative Search

arXiv:2608.23252v1 Announce Type: cross Abstract: As Retrieval-Augmented Generation (RAG) shifts toward diverse portfolio generation, it is stymied by two critical bottlenecks: flawed measurement of...

By Peiyang Liu, Xi Wang, Di Liang, Wei Ye

llms rag agents

arXiv Computation and Language

Aug 25

CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild

arXiv:2608.23181v1 Announce Type: cross Abstract: As large language models (LLMs) continue to advance in coding capabilities, their potential in cybersecurity has drawn increasing research attention,...

By Jian Yang, Haau-Sing Li, Shawn Guo, Zixi Zhao, Yibo Tan, Jiajun Wu, Aishan Liu, Xianglong Liu, Tianyu Zheng, Bryan Dai, Chengran Yang

llms agents nlp

arXiv AI

Aug 25

Mission-Aligned Learning-Informed Control of Autonomous Systems: Formulation and Foundations

arXiv:2507.04356v3 Announce Type: replace-cross Abstract: Research, innovation and practical capital investment have been increasing rapidly toward the realization of autonomous physical agents. This...

By Vyacheslav Kungurtsev, Alessandro Di Frenna, Gustav Sir, Monicah Cherop Naibei, Haozhe Tian, Homayoun Hamedmoghadam, Akhil Anand, Sebastien Gros

agents reinforcement-learning robotics safety

arXiv Computation and Language

Aug 25

Spine-Branch Coordination for Multi-agent Computer Use

arXiv:2608.22077v1 Announce Type: new Abstract: Computer use agents (CUAs) are increasingly deployed as multi-agent systems that decompose a task into multiple subtasks executed across parallel virtu...

By Mian Zhang, Manasi Sharma, Sheng Zhang, Minglai Yang, Kejian Shi, Ying Liu, Zhiyu Zoey Chen, Daniel Yue Zhang

agents

arXiv Computation and Language

Aug 25

A Source-Grounded Framework for Constructing and Evaluating Progressive Multimodal Diagnostic Dialogues from Clinical Case Reports

arXiv:2608.22713v1 Announce Type: new Abstract: Clinical diagnosis requires progressive integration of patient history, physical examination, laboratory findings, medical images, and diagnostic-infor...

By Yufan Wang, Rui Yang, Yi Liu, Yi Lin, Yifan Peng

llms agents multimodal benchmarks

arXiv Computation and Language

Aug 25

From Diagnosis to Redesign: Using Quantitative Ethnography to Improve Multi-Agent LLM Reasoning

arXiv:2608.22566v1 Announce Type: new Abstract: Multi-agent large language model (LLM) systems are designed to improve reasoning by decomposing tasks across multiple agents with specialized functions...

By Vedant Khatri, Anthony Cusimano, Zachari Swiecki, Zhen Xu, Xiner Liu, Renzhe Yu

llms agents

arXiv AI

Aug 25

Constructing Predictive Surgical Path for AI-based Capsulorhexis Skill Transfer

arXiv:2608.21441v1 Announce Type: cross Abstract: Automated training of surgeons is one of the most crucial factors that significantly minimize surgical training risks and expenses. With recent advan...

By Mohammad Javad Ahmadi, Hamid D. Taghirad

agents

arXiv AI

Aug 25

Agentic Security: A Systematization of Tools, Failure Modes, and Design Laws for LLM-Driven Penetration Testing

arXiv:2608.21423v1 Announce Type: cross Abstract: Agentic security uses large-language-model (LLM) agents to plan, dispatch, and interpret security tools. As these systems move from demonstrations to...

By Israt Moyeen Noumi, Tarannum Ahmed Nowshin, Md. Mehedi Hasan Nipu, Mohammad Sakib Mahmood, Md. Jakir Hossain, M. F. Mridha

llms agents safety

arXiv AI

Aug 25

RoboShape: Information-Theoretic Point Cloud Representations for Privacy-Aware Robot Perception

arXiv:2608.21380v1 Announce Type: cross Abstract: With the increased adoption of robotic agents operating in human environments by scanning and sharing 3D representations (e.g., for fleet learning, c...

By Oguzhan Baser, Mirac Sozen, Kaan Kale, Sandeep Chinchali, Sriram Vishwanath

rag agents robotics safety

arXiv AI

Aug 25

EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards

arXiv:2608.23525v1 Announce Type: new Abstract: Earth-system analysis reconstructs changing physical processes from observations that differ in source, scale, timing, and modality. Natural hazards ma...

By Zhiqing Cui, Xinxiang Yin, Yihong Tang, Xinglang Zhang, Yuanzhe Hu, Siru Zhong, Weidong Tang, Yuxuan Liang, Weijia Li, Ming Jin, Shirui Pan, Yuhao Kang, Dingyi Zhuang, Jinhua Zhao

agents benchmarks

arXiv AI

Aug 25

Apodex 1.1: Scaling Agentic Intelligence for Complex Work

arXiv:2608.23283v1 Announce Type: new Abstract: General-purpose language models can reason and synthesize knowledge, but complex work also requires sustained interaction with files, information sourc...

By Apodex Team, B. An, B. Li, B. Wang, B. Zhang, B. L. Wang, C. Feng, C. Wei, C. Xue, C. Zhang, D. Ng, D. Ye, E. Min, F. Chen, F. Liu, F. Yang, F. Ye, H. Xu, H. Yang, H. Ye, H. Zhang, H. Zhao, J. Li, J. Lin, J. Xia, K. Jin, K. Wang, K. Yang, L. Bing, L. Lei, L. Su, Le. Wang, Lu. Wang, N. Wang, Q. Ren, Q. Yang, R. Li, S. Bai, S. Du, S. Li, S. Lin, S. Nie, S. Wang, S. Zhang, S. Z. Wang, Ta. Q. Fang, Ti. Q. Fang, W. Fang, W. Li, W. Zhang, X. Chen, X. Li, X. Tang, X. Wang, X. Xu, X. Zhang, X. Q. Wang, X. Y. Wang, Y. Deng, Y. Gao, Y. Hu, Y. Li, Y. Sui, Y. Wang, Y. Xiao, Y. Zhang, Z. Chen, Z. Cheng, Z. Feng, Z. Liang, Z. Zhang

llms agents

arXiv AI

Aug 25

LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications

arXiv:2608.23058v1 Announce Type: new Abstract: Large language models (LLMs) now support forecasting systems that combine language-based reasoning with temporal data, evidence retrieval, external too...

By Xiaogang Xu, Jiaqi Tang, Jianmin Chen, Yingying Yan, Zhenchao Tang, Xiangxin Zhou, Xiaobin Hu, Wei Wei, Jinfeng Wu, Qifeng Chen, Lu Zhou, Jiafei Wu, Zhe Liu, Jianwei Yin, Weimin Zheng

llms rag agents benchmarks

arXiv AI

Aug 25

MobilePA-Bench: Benchmarking Mobile Planner Agents on Complex Real-World Tasks

arXiv:2608.23035v1 Announce Type: new Abstract: As on-device LLM agents evolve into personal copilots, the mobile operating system has become a key testbed for this paradigm, making rigorous capabili...

By Yi Zhu, Xiongwei Wu, Qiyi Wang, Tingyu Qu, Jiajun Liu, Sihan Cao, Long Chen, Weigao Sun, Feida Zhu, Yiran Zhong, Steven Hoi

llms agents reinforcement-learning robotics benchmarks

Get the daily briefing