arXiv AI

Following Delegation Traces to Study Human Oversight in Interaction with Multimodal AI

The study examined how users delegate control to multimodal AI by analyzing 392 video question‑answering trials with 56 AI‑literate participants. Participants rated trust after each AI response and chose one of three delegation policies—reject, verify, or fully delegate. Findings showed that higher post‑interaction trust predicted delegation choices, verification was the most common policy, and delegation increased with task order, suggesting experience influences trust beyond self‑reported ratings.

Hugging Face Trending Papers
Aug 11

Conversational versus Dashboard Explainable AI for UAV Intrusion Detection: An Empirical Study of Operator Trust and Reliance

Machine learning-based Intrusion Detection Systems (IDS) have demonstrated superior performance in securing Unmanned Aerial Vehicle (UAV) networks. However, the 'black-box' nature of these models, combined with the high dimensionality of multimodal cyber-physical data, poses significant interpretability challenges.

arXiv Computer Vision
Oct 22

Multimodal Embodied Agents: A Unified Capability-centric Perspective from Computer-Use to Robot-Use

The paper introduces Multimodal Embodied Agents (MMEAs), goal‑directed systems that combine multimodal task reasoning with physical action and adapt decisions based on feedback. It proposes the PAPAV framework, which defines five core capabilities—Perceive, Anticipate, Plan, Act, Verify—common to computer‑use agents, robotic systems, and MMEAs. The authors analyze 64 benchmarks, noting that most evaluations focus on Act while Anticipate and Verify are rarely assessed, highlighting gaps and open challenges in designing reliable physical agents.

By Yanzhe Chen, Ziyi Yang, Jifeng Zhu, Qiming Huang, Ruihe An, Peiyao Xu, Hesen Yang, Runda Liu, Chang Gong, Zhijun Cao, Zechen Bai, Wenzheng Zeng, Yiqi Lin, Guoqiang Liang, Kevin Yuchen Ma, Kevin Qinghong Lin, Mike Zheng Shou
arXiv AI
Oct 2

When Reasoning Helps Action: Monitoring and Steering Chain-of-Thought in Vision-Language-Action Policies

The paper introduces TRUST, a token‑level reward model that predicts the correctness of partial chain‑of‑thought (CoT) traces in vision‑language‑action (VLA) policies, enabling monitoring and selective steering of reasoning. On driving and manipulation VLA benchmarks, TRUST improves reasoning accuracy and reduces collision rates and trajectory errors, though its impact on overall task performance varies across tasks. The study defines two evaluation axes—correctability and actionability—to assess when CoT can serve as a runtime safety interface.

By Sathwik Karnik, Joseph JR. Lee, Aryaman Gupta, Somil Bansal
arXiv Computation and Language
Aug 24

Trust Stack for Mental Health AI: A Survey of Calibration across Human, Interaction, and AI Layers

The paper surveys 61 studies on mental‑health AI and identifies a misalignment in how trust is evaluated across disciplines. It proposes a three‑layer framework—human‑oriented, interaction‑oriented, and AI‑oriented trust—and maps stakeholder perspectives onto these layers. The authors argue that future research should focus on calibrating human trust to actual interaction and AI trustworthiness rather than merely maximizing perceived trust.

By Xin Sun, Yue Su, Yifan Mo, Qingyu Meng, Yuxuan Li, Min Chen, Mengyuan Zhang, Saku Sugawara, Charlotte Gerritsen, Sander L. Koole, Koen Hindriks, Jiahuan Pei
arXiv Computation and Language
Sep 22

Checkpoints Are Not Enough: Trust Calibration in CoSLR, a Human-AI System for Systematic Literature Reviews

The paper introduces CoSLR, a Human‑AI collaborative system for systematic literature reviews that incorporates mandatory human checkpoints within a three‑phase pipeline using large language models and Retrieval‑Augmented Generation. In a survey of 63 participants, 42.9 % rated the system’s usability highly, yet 34.9 % indicated they would trust AI‑generated summaries without further human verification after brief interaction. The study highlights that effective human oversight in AI‑assisted literature reviews depends on users’ willingness to engage with the checkpoints, underscoring a calibration issue that interface design must directly address.

By MD Aidul Islam, Malik Abdul Sami, Muhammad Waseem, Zeeshan Rasheed, Kai-kristian Kemell, Zheying Zhang, Pekka Abrahamsson