AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,805 stories · RSS feed

arXiv Computer Vision

Aug 25

ReWorld: Representation Learning for World Action Models

arXiv:2606.27504v2 Announce Type: replace Abstract: World Action Models (WAMs) unify future environment prediction with action generation for autonomous driving, yet existing approaches optimize only...

By Tianze Xia, Lijun Zhou, Kaixin Xiong, Jingfeng Yao, Zhenxin Zhu, Haiyang Sun, Bing Wang, Guang Chen, Wenyu Liu, Hangjun Ye, Xinggang Wang

agents reinforcement-learning robotics

arXiv Computer Vision

Aug 25

VLM- and LLM-Driven Multi-Agent System for PET Image Denoising

arXiv:2608.13791v2 Announce Type: replace-cross Abstract: Positron emission tomography (PET) imaging suffers from limited spatial resolution and low signal-to-noise ratio, which can compromise quanti...

By Boxiao Yu, Savas Ozdemir, Yang Xing, Fumio Hashimoto, Jiong Wu, Yizhou Chen, Axel Rominger, Ruogu Fang, Kuangyu Shi, Tinsu Pan, Kuang Gong

llms agents diffusion multimodal

arXiv Computer Vision

Aug 25

Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation

arXiv:2607.10744v5 Announce Type: replace Abstract: Benefiting from the powerful priors embedded in large-scale pre-training data and the emerging commonsense reasoning ability, large language models...

By Changfei Fu, Guangcheng Chen, Aoxiang Gu, Haoxiang Liang, Wenjun Xu, Hong Zhang

llms rag agents robotics fine-tuning multimodal benchmarks

arXiv AI

Aug 25

Beyond Success and Failure: Length-Aware Contrastive Learning for GUI Agents

arXiv:2608.21830v1 Announce Type: new Abstract: Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) have shown strong potential for automating tasks across diver...

By Chengyang Gu, Le Zhang, Jingbo Zhou, Yize Chen, Yu Shi, Siqi Bao, Zheng-Fan Wu, Hua Wu, Hui Xiong

llms agents reinforcement-learning multimodal benchmarks

arXiv AI

Aug 25

Budget-Constrained Embodied Perception: Four Resource Walls and a Pre-Registered Evaluation of Access-Structured Perception on Open Models at less than 31B

arXiv:2608.22975v1 Announce Type: new Abstract: Embodied multimodal agents must answer from growing observation streams under a fixed per-decision token budget. We formalize this constraint through f...

By Defu Lin, Wenhui Chen, Ziyao Lin, Jianlin Chen, Peiji Long, Chi Man Vong

agents robotics multimodal benchmarks

arXiv AI

Aug 25

ECHO: A Cognitively Inspired, Auditable Memory Plane for Long-Horizon Agents

arXiv:2608.21755v1 Announce Type: new Abstract: Long-horizon agents need memory that identifies relevant experience, resolves revisions, and exposes checkable provenance. We present ECHO (Embodied Co...

By Yu Qian, Hong Miao, Boyang Guo, Tingyi Jiang, Shan Zhao, Tianxing Le, Lintian Li, Meng Liu

agents robotics

arXiv Computer Vision

Aug 25

Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints

arXiv:2602.07008v5 Announce Type: replace Abstract: Reliable models should not only predict correctly, but also base their decisions on acceptable evidence. However, conventional supervised learning...

By Ruoyu Chen, Shangquan Sun, Xiaoqing Guo, Kangwei Liu, Sanyi Zhang, Zhangcheng Wang, Shiming Liu, Qunli Zhang, Wei Wang, Hua Zhang, Xiaochun Cao

agents computer-vision safety

arXiv AI

Aug 25

ATHENA: Knowledge-guided agentic neural architecture search for AutoFormer-based electronic health record modeling

arXiv:2608.21712v1 Announce Type: new Abstract: Transformer-based models are widely used for clinical prediction from electronic health records (EHRs), yet their architectures still require substanti...

By Deyi Li, Qi Xu, Lingyao Li, Tiansheng Wang, Muxuan Liang, Mei Liu

llms agents fine-tuning

arXiv AI

Aug 25

Context as an Environment: Programmatic Context Management for Long-Horizon Agents

arXiv:2608.21690v1 Announce Type: new Abstract: LLM agents increasingly take on long-running tasks whose history grows far beyond a single model context window. Existing approaches compress earlier i...

By Yin Lin, Elaine Ang, Erkang Zhu, Bolin Ding, Jingren Zhou

llms agents

arXiv AI

Aug 25

Buried in Textual Debt: Context Pruning with Visual Evidence Preservation for MLLM Agents

arXiv:2608.22963v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed as multi-step agents, where explicit reasoning supports task decomposition and tool...

By Yuchen Huang, Sijia Li, Jun Zhang, Yi R. Fung

llms agents fine-tuning efficiency multimodal benchmarks

arXiv AI

Aug 25

Repo2Skill-Evo: Repository Skills Go Stale in Silence

arXiv:2608.21964v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly operate over evolving software repositories, where success depends on repository-specific procedural kno...

By Chenyuan Duan, Ge Shi, Zineng Mao, Ge Zhang, Hao Liang, Yinzhu Piao, Yuchen Wu, Zhixin Yao, Kaiyu Huang, Wenhao Huang, Linzhuang Sun, Shen Yan, Wentao Zhang

llms agents

arXiv Computer Vision

Aug 25

Dual-Grained Agent Memory and Shapley Context Attribution for Multimodal Agentic Learner

arXiv:2608.23268v1 Announce Type: new Abstract: Frontier multimodal large language models (MLLMs) deliver impressive perception yet still falter on scientific and mathematical reasoning. Parameter-le...

By Jieke Wang, Tiancheng Shen, Yibo Yang, Ming-Hsuan Yang

llms agents multimodal

arXiv AI

Aug 25

From Inertia to Objectivity: Improving Deep Research Agents with Noise Isolation

arXiv:2608.23045v1 Announce Type: new Abstract: Web search agents powered by Large Language Models (LLMs) show strong promise, but deep research tasks expose a recurring failure mode: once an agent h...

By Xiangxin Zhang, Zhanwei Zhang, Zhihang Fu, Binbin Lin, Wenxiao Wang

llms agents benchmarks safety

arXiv AI

Aug 25

HiMA-MDD: A Hierarchical Multi-Agent Harness for Interpretable Multimodal Depression Detection in Clinical Interviews

arXiv:2608.21868v1 Announce Type: new Abstract: Depression assessment from multimodal clinical interviews requires integrating dispersed evidence from multiple symptoms into a coherent PHQ-8 profile....

By Ao Chen, Xiaojiang Peng

llms agents multimodal benchmarks

arXiv AI

Aug 25

AI Watchdog: Agent Interfaces for Detecting and Defending Against Manipulative Dark Patterns in AI Conversations

arXiv:2608.21841v1 Announce Type: new Abstract: Conversational AI increasingly shapes consequential decisions, yet users have limited support for recognizing and resisting manipulation. We present AI...

By Rachel Poonsiriwong (Pub), Chayapatr (Pub), Archiwaranguprok, Constanze Albrecht, Monchai Lertsutthiwong, Pattie Maes, Pat Pataranutaporn

agents robotics safety

arXiv Computer Vision

Aug 25

Spiking Neural Networks for Energy-Efficient Object Detection in Forward-Looking Sonar Imagery

arXiv:2608.22072v1 Announce Type: new Abstract: Autonomous underwater vehicles (AUVs) are increasingly important tools in industries ranging from research, to energy, to defense. AUVs are power-const...

By Gwenevere Frank, Gert Cauwenberghs

agents computer-vision benchmarks

arXiv Computer Vision

Aug 25

MSM-Mem: A Universal Medical Structured Multimodal Memory Framework for Medical AI Agents

arXiv:2608.21810v1 Announce Type: cross Abstract: Clinical decision-making is inherently experience-driven: physicians progressively refine their reasoning by synthesizing patient history, multimodal...

By Md Asaduzzaman Jabin, Khoa Le, Lin Zhao, Tianming Liu

llms agents multimodal

arXiv AI

Aug 25

LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications

arXiv:2608.23058v1 Announce Type: new Abstract: Large language models (LLMs) now support forecasting systems that combine language-based reasoning with temporal data, evidence retrieval, external too...

By Xiaogang Xu, Jiaqi Tang, Jianmin Chen, Yingying Yan, Zhenchao Tang, Xiangxin Zhou, Xiaobin Hu, Wei Wei, Jinfeng Wu, Qifeng Chen, Lu Zhou, Jiafei Wu, Zhe Liu, Jianwei Yin, Weimin Zheng

llms rag agents benchmarks

arXiv AI

Aug 25

Jiuge-Tuiqiao: An Interpretable Human-AI System for Classical Chinese Poetry Refinement

arXiv:2608.23098v1 Announce Type: new Abstract: Classical Chinese poetry composition has long valued Tuiqiao, the iterative refinement of words, imagery, and prosody. However, many current AI poetry...

By Yufeng Han, Lifan Deng, Cunliang Kong, Wenhao Li, Xin Cong, Yuzhuo Bai, Kangyang Luo, Maosong Sun

agents safety

arXiv Computer Vision

Aug 25

ShotVerse: Advancing Cinematic Camera Control for Text-Driven Multi-Shot Video Creation

arXiv:2603.11421v2 Announce Type: replace Abstract: Text-driven video generation has democratized film creation, but camera control in cinematic multi-shot scenarios remains a significant block. Impl...

By Songlin Yang, Zhe Wang, Xuyi Yang, Songchun Zhang, Xianghao Kong, Taiyi Wu, Xiaotong Zhao, Ran Zhang, Alan Zhao, Anyi Rao

llms agents diffusion multimodal

Get the daily briefing