arXiv AI

Building Trust in Artificial Intelligence: A Necessity for Railway Applications

The article discusses the necessity of building trust in AI for railway applications, highlighting that AI is currently limited to non‑safety critical uses due to stringent industry standards. It proposes focusing on three key areas—robustness, Operational Design Domain (ODD), and explainability—to meet compliance and safety requirements. By integrating these domains within a safe MLOps environment, the authors argue that regulatory acceptance and public confidence can be achieved, enabling broader AI adoption in mission‑critical railway systems.

arXiv AI
Jul 10

The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysis

arXiv:2408. 02379v2 Announce Type: replace-cross Abstract: Developing and certifying safe - or so-called trustworthy - AI has become an increasingly salient issue, especially in light of upcoming regulation such as the EU AI Act.

By Benjamin Fresz, Vincent Philipp G\"obels, Safa Omri, Danilo Brajovic, Andreas Aichele, Janika Kutz, Jens Neuh\"uttler, Marco F. Huber
arXiv AI
Sep 10

Towards Trustworthy Physical AI: From Theory to Practice Across Life Cycle

The paper introduces the concept of Physical AI—systems that understand and act within the physical world, where interactions are continuous, uncertain, and irreversible. It surveys trustworthy principles specific to Physical AI, outlines the role of physics in AI, and maps the end‑to‑end life cycle across five core stages, culminating in the Trustworthy Physical AI Operationalization (T‑PAIO) and the broader Trustworthy Physical AI (T‑PAI) framework.

By Wang Yang, Hongxuan Liu, Xinghui Xu, Arjun Menon, Xiaoran Cai, Yunyu He, Jingzong Zhou, Mengzhong Ma, Xinpeng Wei, Nathaniel Dennler, Yi Yu, Shaobo Wang, Cheng Peng, Aoran Jiao, Alexei Korolev, Ashis G. Banerjee, Yanyan Zhang, Kai Ye, Xinpeng Li, Chengquan Guo, Jingjing Fu, Marius Urbonas, Traian Tus, Gaoyue Zhou, George Ortiz, Irmak Guzey, Silei Ren, Lars Johannsm eier, Rohit Sharma, Felix Feng, Yoshua Bengio, Peng Qi
arXiv AI
Jul 22

Engineering Trustworthy Agentic AI for Critical Systems

arXiv:2607. 18548v1 Announce Type: new Abstract: Agentic artificial intelligence systems, capable of autonomous perception, planning, tool use, and multi-step action, are increasingly proposed for critical engineering domains where decisions carry physical, operational, or economic consequences.

By Omar Al-Refai, Ibrahim Shahbaz, Adam Ali Husseinat, Michael Mandulak, Jaewon Kim, Eman Hammad
arXiv AI
Jul 20

Closing the AI Trust Gap: The Case for Independent Certification for Trustworthy AI

arXiv:2607. 15992v1 Announce Type: new Abstract: Over the past decade, responsible AI (RAI) has produced a substantial body of practice for identifying and mitigating the risks AI poses in high-stakes settings.

By Trisevgeni Papakonstantinou, Cansu Canca, Farah Nanji, Waheedullah Pardess, Jen Weedon, Jasmijn Remmers, Eliza Krigman, Matthew Ball, Yalda Daryani, Kiran Iqbal, Francielle Vargas, Mar\'ia Llorente S\'anchez, Joe Humphreys, Fendi Tsim, Kelly Fitzpatrick, Jeff Dunn, Catherine Feldman
arXiv AI
Sep 12

Understanding Operator Attitudes Toward AI-Supported Decision Making in Maritime Operations

The study surveyed maritime professionals on their attitudes toward AI‑supported decision assistants in collision‑avoidance scenarios. Results show a generally positive disposition toward maritime technology, stable trust across scenarios, and nuanced, scenario‑sensitive ratings of explanation quality. Open‑ended feedback highlighted the importance of decision‑support, situational awareness, and confidence‑building, while raising concerns about AI reliability, over‑reliance, and loss of expertise.

By Doreen Jirak, Armeen Saroukanoff, Dirk van Rooy