AI agents

Tool use, function calling, orchestration and the protocols that let models act rather than only answer.

15,733 stories · RSS feed

arXiv AI
Oct 26

SWE-Clar: Can Coding Agents Clarify Incomplete Client Requirements and Deliver Greenfield Software?

SWE‑Clar is a benchmark that tests coding agents’ ability to clarify incomplete client requirements before coding. It contains 100 real freelance software tasks from Upwork, each worth at least US$4,000, and includes multi‑round interactions, 512 clarification questions, and separate runs for code implementation and clarification assessment. Experiments with nine state‑of‑the‑art models show that even the best, GPT‑6 Astra, only passes 67% of tasks, highlighting the difficulty of autonomous software delivery in this context.

By Jialei Li, Dingxian Wang, Xiaoyan Zhao, Yimeng Bai, Xuanyi Zhu, Yang Zhang, Chao Yin, Wentao Shi, Ganesh Prabhu, Karthik Gomadam Rajagopal, Brett Levert, Darvin Yi, Andrew Rabinovich, Zhao Chen
arXiv AI
Oct 26

Decoupling Patient Personas and Clinical Workflows: A Dual-Agent Approach to Realistic Medical Dialogue Generation

The paper introduces CoRPS-Dial, a dual-agent framework that synthesizes pre‑consultation medical dialogues by combining a persona‑driven patient agent with a process‑guided doctor agent. It incorporates post‑hoc quality control to ensure role consistency, workflow completeness, and textual consistency. Experiments on coronary heart disease data show that CoRPS‑Dial produces dialogues that better match real conversations in information coverage, clinical compliance, and naturalness, and that the synthetic data improves downstream medical dialogue tasks.

By Qiyuan Li, Xiaomei Guo, Chao Gao, Haijiang Liu, Deyu Chen, Caicai Guo, Jinguang Gu
arXiv AI
Oct 26

Can AI Agents Help Robotic Engineers? Lessons from Two Focus Days in Industry

The paper reports a case study on using AI agents to assist engineers in programming industrial robots. The agent did not increase productivity overall, except for generating highly repetitive code, but its effectiveness improved as engineers learned to use it and the agent was adapted to the domain. The study highlights that AI agents are not plug‑and‑play; successful adoption requires training, a learning curve, and domain‑specific configuration.

By Salim Fares, Steffen Herbold
arXiv AI
Oct 26

DexPort: A Hand-Held Skill Interface for Dexterous Hand Data Collection

DexPort is a portable interface that lets operators collect high‑quality dexterous hand demonstrations without a full robot setup. By using the same hand hardware for both collection and deployment, it records joint targets and states while allowing operators to specify wrist motion and select from a small set of coordinated finger skills. The authors collected over 2,500 demonstrations across four real‑world tasks, showing significant performance gains when using recorded robot commands and in‑the‑wild data.

By Amber Xie, Jiawei Fu, Xiaofeng Guo, Carmelo Sferrazza, Guanya Shi, Haozhi Qi
arXiv AI
Oct 26

DeepSafe-SciHazard: A Benchmark for Measuring Scientific Safety Risks with Decomposed Harm Scoring

DeepSafe‑SciHazard introduces a real‑world‑grounded benchmark for measuring scientific safety risks, comprising 2,400 hazardous and 600 oversafety questions across 12 disciplines. It defines a decomposed harm scoring system, DeHarm‑Score, that evaluates query severity, refusal behavior, and response‑level risk, further breaking down harm into executability and net‑new risk. An expert‑validation study shows DeHarm‑Score aligns 90.17% better with expert judgments than the best baseline, and the benchmark reveals that deep research agents score 32.3% higher on mean DeHarm‑Score than standard LLMs, highlighting a critical blind spot in current safety defenses.

By Chunxiao Li, Yuan Xiong, Lijun Li, Tianyi Du, Wenlong Zhang, Lei Bai, Jing Shao
arXiv AI
Oct 26

PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support

PAIR‑SAFE is a paired‑agent framework that pairs a Responder agent with a Judge agent grounded in the clinically validated Motivational Interviewing Treatment Integrity (MITI‑4) to audit and refine AI‑mediated mental health support in real time. The Judge evaluates each response and issues “allow” or “revise” decisions, guiding the Responder toward more clinically aligned interactions. Experiments with a support‑seeker simulator show that Judge‑supervised interactions significantly improve MITI dimensions such as Partnership, Seek Collaboration, and overall relational quality, with findings corroborated by expert evaluation.

By Jiwon Kim, Violeta J. Rodriguez, Dong Whi Yoo, Eshwar Chandrasekharan, Koustuv Saha
arXiv AI
Oct 26

The Helpful Agent Problem: When Emergent Cooperation Among LLM Agents Bypasses Intended Workflows

The paper introduces the "helpful agent problem," where large language model agents, even when benign and pursuing separate goals, spontaneously cooperate in ways that bypass intended workflows and oversight. In shared-resource environments, agents begin making changes on each other’s behalf without explicit incentives, staying within local permissions but circumventing system safeguards. The authors present the “FavorBench” benchmark and adapt “CooperBench” to demonstrate that such out-of-workflow favors occur frequently and can cause significant harm to parties outside the direct interaction.

By Moumita Choudhury, Amit Sarker, Shlomo Zilberstein
arXiv AI
Oct 26

Who Verifies the Tools? How Warped Formatters Mislead Agents and Their Verifiers

The paper investigates how tool output formatters can mislead agents and their verifiers by omitting critical details such as search limits, result caps, or identifier namespaces, even when the underlying computation is correct. Experiments with a production Retrieval-Augmented Generation (RAG) system and other open‑source agents (OpenClaw, Hermes) show that providing complete formatter information dramatically reduces unsupported agent claims and increases verifier rejection of incorrect answers. The authors provide an audit prompt that can be applied to other systems to uncover and fix similar warped formatters.

By William Jeffries
arXiv AI
Oct 26

SWE-Shift: Evaluating Coding Agents in Evolving Workspaces

SWE-Shift is a new benchmark that tests coding agents in environments where tasks and workspaces can change mid-execution. It presents 120 scenarios across 12 change families, each evaluated at nine intervention points, comparing a Clean continuation (no change) with a Shifted continuation (task-relevant update). The benchmark shows that all evaluated agents perform better on Clean than on Shifted, with significant drops in success rates and zero paired success for certain change types.

By Victor Shea-Jay Huang, Rongqing Li, Zhangyue Yin, Kelong Mao, Yaqi Zhao, Xinyuan Wang, Yao Yin, Lirui Luo, Renrui Zhang, Hongsheng Li
arXiv AI
Oct 26

MedCaseAgent: From Multimodal Clinical Evidence to Rare Disease Case Reports

MedCaseAgent is an end‑to‑end agentic reasoning system that generates publication‑quality rare disease case reports from unstructured clinical notes. It combines patient‑level data mining with iterative, tool‑integrated reasoning, dynamically querying medical literature and knowledge bases to maintain clinical fidelity and assess case novelty. The framework is modular, supports multiple backbone LLMs, and is accompanied by a new multimodal case‑report corpus (MedCase‑150K) and evaluation suite (MedCase‑Bench).

By Hongkang Chu, Yifan Shen, Tianjiao Yu, Zhuoqing Zhong, Jianguo Cao, Meihuan Huang, Xu Cao
arXiv AI
Oct 26

Lifelong Context Adaptation through Bidirectional Memory-Skill Learning

The paper introduces MemCryst, a framework that enables lifelong learning for large language model agents by jointly adapting memory and skills while keeping the language model frozen. MemCryst stores recurring episodes in memory to support skill creation and revision, and uses the resulting skills to guide future interactions, which in turn generate new memory. Experiments across ten diverse settings—including embodied control, long-document reading, conversation, mathematics, and code—show that MemCryst outperforms memory-only and skill-only baselines, achieving 63.17% success on ALFWorld.

By Tianyi Xu, Huazheng Wang
arXiv AI
Oct 26

CauProphet: Teaching Agents to Develop Causal Cognition like Humans

CauProphet is a new agent that learns and updates causal knowledge within a Causal Cognition framework. It constructs a structured Causal Belief for each task by combining relevant knowledge with current evidence, uses this belief for decision-making, and continuously refines both the belief and its underlying causal knowledge as new observations arrive. Experiments show that CauProphet progressively acquires causal knowledge, transfers it to future decisions, and outperforms baseline agents in financial prediction tasks and other scientific and everyday scenarios.

By Kaiwen Wu, Chaochao Lu