arXiv AI By Wei Wang, Shuanghe Liu, Zhu Zhuo, Jiaqi Zhong, Xiaozhao Zhao, Xiaojie Zuo, Jie Su

CockpitHAT: Dependency-Graph-Driven Hierarchical Attribution for Embodied Multi-Agent Cockpits

Read the original on arXiv AI →

CockpitHAT is a hierarchical attribution framework for embodied multi‑agent systems that replaces positional windows with dependency‑distance thresholds derived from interaction DAGs, incorporates multi‑channel evidence through an embodied adapter, and applies a safety‑uplift to high‑risk failures during confidence‑weighted analyst consensus. The authors also release CockpitBench, a benchmark of 212 annotated failure traces labeled with ISO 26262 ASIL severity. On both the public Who&When benchmark and CockpitBench, CockpitHAT outperforms the text‑only state‑of‑the‑art ECHO, achieving higher agent‑level and step‑exact accuracies across multiple splits.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 2

DeFA: Dependency-Guided Failure Attribution for LLM Agents

DeFA is a dependency-guided framework that attributes failures in large language model agents by constructing an event dependency graph and a failure propagation graph from protocol relations and semantic dependencies. It identifies violating events, traces their sources and effects, and determines the decisive error, responsible agent, and error category. The method supports long trajectories through segmentation and has shown superior accuracy on text, image, and video tasks, while its diagnostic feedback can improve agent performance on subsequent tasks.

By Bo Deng, Xinlei Zheng, Yi Wei, Kang Zhou, Chongyang Tao, Renzhao Liang, Xuanren Chen, Lifan Guo, Chi Zhang
arXiv AI
Aug 18

AeroCopilotBench: A Two-Tier Benchmark for Evaluating LLM Agents as Aviation Copilots in an Interactive Virtual Cockpit Environment

arXiv:2608. 16349v1 Announce Type: new Abstract: Large language model (LLM) agents may assist flight crews with complex decisions and task execution, but existing aviation evaluations centered on static knowledge do not support systematic testing of procedural execution and safety compliance in interactive environments.

By Yuchen Yuan, Zhenghuang Wu, Yuangan Li, Liang Ma, Ke Li